Skip to content

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

29 Commits

Folders and files

Repository files navigation

DJI ROS 2 Bridge Runbook

Purpose

This package receives data from the modified DJI Mobile SDK Android sample app and republishes it in ROS 2.

Supported streams:

  • Gimbal attitude over UDP.
  • Aircraft GNSS/RTK position and NED velocity over UDP.
  • DJI H.264 video over TCP.
  • Decoded JPEG camera frames as sensor_msgs/CompressedImage.
  • Optional decoded raw frames as sensor_msgs/Image.
  • Camera FoV metadata over UDP, currently fixed at zoom_factor=1.0 and base_fov_deg=82.6.
  • Litchi-style CSV mission parsing plus optional Android-side MSDK4 waypoint execution.
  • Automatic ROS PC discovery, with manual IP fallback in the Android app.

Data Flow

DJI controller / Android sample app
        |
        | UDP 5007 discovery
        | UDP 5005 gimbal JSON
        | UDP 5008 position JSON
        | UDP 5009 camera FoV JSON
        | TCP 5006 H.264 video
        | TCP 5010 mission commands/results
        v
Ubuntu / ROS 2 PC

Topics

Topic Type Notes
/dji/gimbal_orientation geometry_msgs/msg/Vector3Stamped x=roll_rad, y=pitch_rad, z=yaw_rad
/dji/gimbal_orientation_quat geometry_msgs/msg/QuaternionStamped Quaternion from the same gimbal attitude packet
/dji/gps/fix sensor_msgs/msg/NavSatFix Aircraft GNSS/fused aircraft location
/dji/rtk/fix sensor_msgs/msg/NavSatFix RTK fusion mobile station location when available
/dji/velocity_ned geometry_msgs/msg/Vector3Stamped x=north, y=east, z=down, meters per second
/dji/video/h264 sensor_msgs/msg/CompressedImage Encoded H.264 chunks, format=h264
/dji/image/compressed sensor_msgs/msg/CompressedImage Decoded JPEG frames for rqt_image_view compressed transport
/dji/image_raw sensor_msgs/msg/Image Optional decoded raw frames, disabled by default
/dji/fov_info geometry_msgs/msg/Vector3Stamped x=zoom_factor, y=base_fov_deg, z=adjusted_fov_deg
/dji/mission/plan std_msgs/msg/String Neutral mission plan JSON generated from CSV
/dji/mission/state std_msgs/msg/String Mission planner state JSON
/dji/mission/progress std_msgs/msg/String Mission progress JSON

Mission Services

The mission planner parses and validates Litchi-style CSV files for Mavic 2 Enterprise / MSDK4. By default dry_run:=true, so services only exercise ROS state transitions. With dry_run:=false, the node opens a TCP server on port 5010; the Android app connects back and executes the loaded MissionPlan through DJI's MSDK4 WaypointMissionOperator.

Service Type Current behavior
/dji/mission/load_csv std_srvs/srv/Trigger Reads the file configured by the csv_path parameter
/dji/mission/upload std_srvs/srv/Trigger Dry-run upload or Android MSDK4 upload
/dji/mission/start std_srvs/srv/Trigger Dry-run start or Android MSDK4 start
/dji/mission/pause std_srvs/srv/Trigger Dry-run pause or Android MSDK4 pause
/dji/mission/resume std_srvs/srv/Trigger Dry-run resume or Android MSDK4 resume
/dji/mission/stop std_srvs/srv/Trigger Stops the dry-run state or Android MSDK4 mission

Ports

Port Protocol Direction Purpose
5005 UDP Android -> ROS PC Gimbal attitude JSON
5006 TCP Android -> ROS PC H.264 video stream
5007 UDP Bidirectional Bridge discovery
5008 UDP Android -> ROS PC Position, RTK, and NED velocity JSON
5009 UDP Android -> ROS PC FoV/zoom JSON
5010 TCP Android -> ROS PC Mission command/result bridge

Network Setup

Put the Ubuntu PC and DJI controller on the same hotspot or Wi-Fi network. Avoid guest networks and hotspots with client isolation.

The Android app first tries UDP discovery on port 5007. If discovery fails, enter the Ubuntu PC IP manually in the app's ROS PC IP field before tapping Register APP.

Build

ROS 2 package:

cd ~/work_ws/buscan/buscan_ws
colcon build --packages-select dji_ros2_bridge
source install/setup.zsh

Android app:

cd ~/work_ws/buscan/Mobile-SDK-Android/"Sample Code"
JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64 ./gradlew :app:assembleDebug
cp app/build/outputs/apk/debug/app-debug.apk ../DJI-SDK-gimbal-camera-position-stream.apk

Install DJI-SDK-gimbal-camera-position-stream.apk on the DJI controller. A clean uninstall/reinstall is recommended when changing the Android bridge code.

Run

Start all ROS bridge nodes with the launch file:

cd ~/work_ws/buscan/buscan_ws
source install/setup.zsh
ros2 launch dji_ros2_bridge dji_bridge.launch.py

Then on the DJI controller:

  1. Force-stop DJI Pilot, DJI Pilot 2, Litchi, or any app that may own the DJI product connection.
  2. Open DJI SDK Sample.
  3. Enter ROS PC IP only if discovery is unreliable.
  4. Tap Register APP.
  5. Wait for SDK registration and product connection.
  6. Confirm bridge toasts for gimbal, position, FoV, and video.

Verify

Discovery:

sudo tcpdump -ni any udp port 5007

Gimbal:

sudo tcpdump -ni any udp port 5005 -A
ros2 topic echo /dji/gimbal_orientation

Position:

sudo tcpdump -ni any udp port 5008 -A
ros2 topic echo /dji/gps/fix
ros2 topic echo /dji/rtk/fix
ros2 topic echo /dji/velocity_ned

FoV:

sudo tcpdump -ni any udp port 5009 -A
ros2 topic echo /dji/fov_info

Expected compact FoV JSON:

{"t":1783416734258,"source":"camera_zoom","zoom_factor":1.000,"base_fov_deg":82.600,"adjusted_fov_deg":82.600}

Video:

ros2 topic hz /dji/video/h264
ros2 topic hz /dji/image/compressed --qos-reliability best_effort
ros2 topic info -v /dji/image/compressed

/dji/video/h264 is the original encoded H.264 stream. It is kept for recording/debugging, but normal ROS image viewers do not decode it directly.

For visualization, use the JPEG compressed image stream:

ros2 run rqt_image_view rqt_image_view

In rqt_image_view, choose the base image topic /dji/image and the compressed transport. If you prefer image_view:

ros2 run image_view image_view --ros-args \
  -r image:=/dji/image \
  -p image_transport:=compressed

/dji/image_raw is disabled by default because it is much larger and caused lag in RViz.

Mission CSV:

ros2 param set /mission_planner_node csv_path \
  "/home/pantelis/Downloads/mission_litchi_fixed_station_actions (1).csv"

ros2 service call /dji/mission/load_csv std_srvs/srv/Trigger {}
ros2 topic echo /dji/mission/plan --qos-durability transient_local
ros2 topic echo /dji/mission/state --qos-durability transient_local

Dry-run mission lifecycle:

ros2 service call /dji/mission/upload std_srvs/srv/Trigger {}
ros2 service call /dji/mission/start std_srvs/srv/Trigger {}
ros2 service call /dji/mission/pause std_srvs/srv/Trigger {}
ros2 service call /dji/mission/resume std_srvs/srv/Trigger {}
ros2 service call /dji/mission/stop std_srvs/srv/Trigger {}

Live Android mission lifecycle:

ros2 param set /mission_planner_node dry_run false
ros2 param set /mission_planner_node csv_path \
  "/home/pantelis/Downloads/mission_litchi_fixed_station_actions (1).csv"

ros2 service call /dji/mission/load_csv std_srvs/srv/Trigger {}
ros2 service call /dji/mission/upload std_srvs/srv/Trigger {}
ros2 service call /dji/mission/start std_srvs/srv/Trigger {}

Watch the bridge state:

ros2 topic echo /dji/mission/state --qos-durability transient_local
ros2 topic echo /dji/mission/progress --qos-durability transient_local

For live execution, the Android app must show product connected and the mission bridge must be connected. If /dji/mission/state reports "android_connected":false, check that ROS was launched before tapping Register APP and that TCP port 5010 is reachable on the current Wi-Fi/hotspot.

Useful Parameters

Video node:

ros2 run dji_ros2_bridge video_h264_tcp_node --ros-args \
  -p tcp_port:=5006 \
  -p discovery_port:=5007 \
  -p jpeg_topic_name:=/dji/image/compressed \
  -p publish_image_compressed:=true \
  -p jpeg_quality:=70 \
  -p publish_image_raw:=false \
  -p image_encoding:=rgb8 \
  -p compressed_reliability:=reliable \
  -p raw_reliability:=best_effort \
  -p raw_max_fps:=15.0 \
  -p raw_width:=480 \
  -p raw_height:=360 \
  -p decode_queue_size:=4

Gimbal node:

ros2 run dji_ros2_bridge gimbal_udp_node --ros-args \
  -p udp_port:=5005 \
  -p rpy_topic_name:=/dji/gimbal_orientation \
  -p quaternion_topic_name:=/dji/gimbal_orientation_quat

Position node:

ros2 run dji_ros2_bridge position_udp_node --ros-args \
  -p udp_port:=5008 \
  -p gps_topic_name:=/dji/gps/fix \
  -p rtk_topic_name:=/dji/rtk/fix \
  -p velocity_topic_name:=/dji/velocity_ned

FoV node:

ros2 run dji_ros2_bridge fov_udp_node --ros-args \
  -p udp_port:=5009 \
  -p fov_topic_name:=/dji/fov_info

Mission planner node:

ros2 run dji_ros2_bridge mission_planner_node --ros-args \
  -p csv_path:="/home/pantelis/Downloads/mission_litchi_fixed_station_actions (1).csv" \
  -p aircraft_name:="Mavic 2 Enterprise" \
  -p sdk_family:=MSDK4 \
  -p max_altitude_m:=120.0 \
  -p max_speed_mps:=15.0 \
  -p dry_run:=true

Set dry_run:=false only when the aircraft, controller, GPS, failsafe, airspace, and mission are ready for real execution.

Source Files

Android app:

File Purpose
Sample Code/app/src/main/java/com/dji/sdk/sample/internal/view/MainContent.java Discovery, manual IP fallback, gimbal UDP, position UDP, FoV UDP, video TCP, lifecycle
Sample Code/app/src/main/java/com/dji/sdk/sample/internal/utils/BridgeVideoPreviewView.java Hidden video preview activator and H.264 packet forwarding
Sample Code/app/src/main/java/com/dji/sdk/sample/internal/utils/DjiMissionBridge.java TCP 5010 mission executor using MSDK4 WaypointMissionOperator

ROS 2 package:

File Purpose
dji_ros2_bridge/gimbal_udp_node.py UDP 5005 -> /dji/gimbal_orientation
dji_ros2_bridge/position_udp_node.py UDP 5008 -> GPS, RTK, velocity topics
dji_ros2_bridge/video_h264_tcp_node.py TCP 5006 + discovery 5007 -> H.264 and JPEG compressed image topics
dji_ros2_bridge/fov_udp_node.py UDP 5009 -> /dji/fov_info
dji_ros2_bridge/mission_planner_node.py Litchi-style CSV -> neutral MissionPlan JSON and mission services
launch/dji_bridge.launch.py Starts all bridge nodes

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages