ROS 2 Humble and Gazebo Harmonic packages to operate the RRC wheelchair.
- Ubuntu (tested on 22.04)
- VSCode
- Remote Development Extension by Microsoft (Inside VSCode)
- Docker Installation
# Install Docker using convenience script curl -fsSL https://get.docker.com -o get-docker.sh sudo sh ./get-docker.sh # Post-install configuration sudo groupadd docker sudo usermod -aG docker $USER # Verify if Docker service is enabled sudo systemctl is-enabled docker # If not enable it sudo systemctl enable docker.service sudo systemctl enable containerd.service
Important
Reboot before proceeding further
# GHCR Authentication
echo "<YOUR_GITHUB_PAT>" | docker login ghcr.io -u <YOUR_GITHUB_USERID> --password-stdin-
Enabling Nvidia GPU for simulation
Hardware Requirement GPU CUDA-enabled Software Requirement Nvidia Driver - Ubuntu 22.04 >=515.43.04
- Ubuntu 24.04>=555.42.02 -
Check Docker docs for more information on docker and Nvidia.
Information about the Hardware Setup:
Motor Driver Controller and Wheel Odometery
- Kangaroo X2 Motion controller
- Sabertooth 2x32 Motor driver
- AMT102-V Wheelencoders
RGB Camera: Realsense D455
- With the current setup we only use realsense for RTABMAP
- No Additional Setup is required for getting data, just plug-in the type-c cable
Omnidirectional camera: Insta360 X5
-
Connect the camera via USB. Once connected, a pop-up page will appear on the camera; on that page, select Android mode.
-
Set
udevrules in your system terminal.echo SUBSYSTEM=='"usb"', ATTR{manufacturer}=='"Arashi Vision"', SYMLINK+='"insta"', MODE='"0777"' | sudo tee /etc/udev/rules.d/99-insta.rules sudo udevadm control --reload-rules sudo udevadm trigger sudo chmod 777 /dev/insta
3D LiDAR: Livox MID-360
- Create new network profile "Livox"
- Configure static IP:
- IP Address: 192.168.1.50
- Netmask: 255.255.255.0
- Create a folder for wheelchair development (preferably in home)
mkdir wheelchair2 && cd wheelchair2 # Clone the repo with submodules git clone https://github.com/Smart-Wheelchair-RRC/wheelchair2.git --recurse-submodules . # Open VSCode code .
- Set ROS DOMAIN ID to a random number between 0 to 101 inside the devcontainer.json file. Please make sure to read the Docs.
{
"containerEnv": {
"ROS_DOMAIN_ID": "42" // Change this to your unique ID between (0 - 101)
}
}-
Enter the container
-
Open Command Pallete with
Ctrl+Shift+P -
Select Dev Containers: Rebuild and Reopen in Container
-
Choose your development container:
Develeopment Container System requirement Use case Jetson ARM system Running Jetson AMD64/x86 with GPU x86 system with Nvidia GPU Running Real-life + Simulation AMD64/x86 without GPU x86 system Running only Real-life
-
-
Build workspace and source
colcon build --symlink-install && source install/setup.bash
-
Wheelchair launch
# For real wheelchair sudo chmod 777 /dev/ttyACM0 # Permission for Motor Driver Controller ros2 launch wheelchair2_bringup wheelchair2.launch.py use_sim_time:=False use_joy:=True # For simulation ros2 launch wheelchair2_gazebo wheelchair2_sim.launch.py use_sim_time:=True use_joy:=True
-
LiDAR launch
ros2 launch wheelchair2_bringup livox.launch.py use_sim_time:=False
-
Camera
# Currently only used for rtabmap ros2 launch realsense2_camera rs_launch.py -
Mapping
# slam_toolbox ros2 launch wheelchair2_navigation online_async_launch.py # rtabmap ros2 launch wheelchair2_navigation rtabmap_lidar_camera_icp.launch.py # FastLIO ros2 launch fast_lio mapping.launch.py config_file:=mid360.yaml
-
Navigation
# AMCL ros2 launch wheelchair2_navigation nav2_amcl.launch.py use_sim_time:=False map:=$MAP_DIR/rrc/rrc_lab.yaml # ICP ros2 launch wheelchair2_navigation nav2_icp.launch.py use_sim_time:=False map:=$MAP_DIR/rrc/rrc_lab.yaml pcd_map_path:=$MAP_DIR/rrc/lab_map_with_outside_corridor.pcd
- Drive link for PCD files
-
Keyboard Telep
ros2 run wheelchair2_control keyboard_teleop_constant.py
-
Data collection
ros2 launch wheelchair2_bringup data_collection.launch.py use_sim_time:=False use_camera1:=True use_camera2:=True use_rivz:=True record:=True use_insta360:=False
To save PCD map files from FastLIO:
- Enable
pcd_save.pcd_save_enin the config file and set themap_file_pathto the path where the map will be saved. - Launch the FastLIO according to README.
[!Note] Make sure to call this before ending the FAST-LIO mapping Node
- Open
rqtin a different terminal after mapping and switch toPlugins->Services->Service Caller. Trigger the service/map_save, then the pcd map file will be generated.
Visualization:
pcl_viewer scans.pcdTips for pcl_viewer:
- Change what to visualize/color by pressing keyboard 1,2,3,4,5 when pcl_viewer is running:
1 is all random
2 is X values
3 is Y values
4 is Z values
5 is intensity
Note
The arguments shown above for each launch file are the default values.
| Argument | Description |
|---|---|
use_sim_time |
Launch in simulation mode (True for simulation, False for hardware connection). |
use_joy |
Use joystick control. |
map |
Specify map file for navigation. |
use_camera1 |
Enable/disable first camera for data collection. |
use_camera2 |
Enable/disable second camera for data collection. |
use_insta360 |
Enable/disable insta360 camera for data collection. |
use_rivz |
Enable/disable RViz visualization for data collection. |
record |
Enable/disable data recording during data collection. |
use_keepout_zone |
Enable/disable keepout zone filtering in navigation. |
use_fast_lio |
Enable/disable FastLIO for mapping. (Put everything else False) |
| Script File | Action |
|---|---|
navigation.tmux |
Runs real wheelchair navigation |
sim_navigation.tmux |
Runs simulation wheelchair navigation |
Scripts are located in wheelchair2_navigation/shell_scripts for convenience.
A couple of convenience functions are provided, implemented as aliases in ~/.bashrc, if you use the post-create script to set up your environment. If using Dev Containers, these will already be set up for you.
-
wssSource WorkspaceThis function sources the workspace setup file.
It is equivalent to running the following command:
source /home/container_user/wheelchair2/install/setup.bash && echo "Sourced wheelchair2 workspace."
-
wsbBuild WorkspaceThis function builds the workspace and then sources it.
It is equivalent to running the following command:
cd /home/container_user/wheelchair2 && colcon build --symlink-install --cmake-args -DCMAKE_EXPORT_COMPILE_COMMANDS=ON && wss
-
wsdDelete Build and Install Directories This function deletes the build, install, and log directories of the workspace.It is equivalent to running the following command:
rm -rf /home/container_user/wheelchair2/build /home/container_user/wheelchair2/install /home/container_user/wheelchair2/log && echo "Deleted build, install, and log directories."
Warning
This option is not maintained frequently so, the latest changes may not be applied here.
- To pull latest docker image
docker pull ghcr.io/smart-wheelchair-rrc/wheelchair2_navigation:v1.0
- To start container
docker run -it \ --rm \ --privileged \ --cap-add=SYS_NICE \ --ulimit rtprio=99 \ --ulimit rttime=-1 \ --ulimit memlock=8428281856 \ --cap-add=all \ --security-opt seccomp:unconfined \ --security-opt apparmor:unconfined \ --volume=/dev:/dev \ --net=host \ --ipc=host \ -e DISPLAY="${DISPLAY}" \ -e WAYLAND_DISPLAY="${WAYLAND_DISPLAY}" \ -e XDG_RUNTIME_DIR="${XDG_RUNTIME_DIR}" \ -e PULSE_SERVER="${PULSE_SERVER}" \ -e QT_X11_NO_MITSHM="1" \ -e LIBGL_ALWAYS_SOFTWARE="1" \ --entrypoint /bin/bash \ --name wheelchair2-navigation \ ghcr.io/smart-wheelchair-rrc/wheelchair2_navigation:v1.0
- Inside the container to run the Navigation stack - follow the above instructions
- To pull latest docker image
docker pull ghcr.io/smart-wheelchair-rrc/wheelchair2_navigation_jetson:v1.0
- To start container
docker run -it \ --rm \ --privileged \ --cap-add=SYS_NICE \ --ulimit rtprio=99 \ --ulimit rttime=-1 \ --ulimit memlock=8428281856 \ --cap-add=all \ --security-opt seccomp:unconfined \ --security-opt apparmor:unconfined \ --volume=/dev:/dev \ --net=host \ --ipc=host \ -e DISPLAY="${DISPLAY}" \ -e WAYLAND_DISPLAY="${WAYLAND_DISPLAY}" \ -e XDG_RUNTIME_DIR="${XDG_RUNTIME_DIR}" \ -e PULSE_SERVER="${PULSE_SERVER}" \ -e QT_X11_NO_MITSHM="1" \ -e LIBGL_ALWAYS_SOFTWARE="1" \ --entrypoint /bin/bash \ --name wheelchair2-navigation-jetson \ ghcr.io/smart-wheelchair-rrc/wheelchair2_navigation_jetson:v1.0
- Inside the container to run the Navigation stack - follow the above instructions
Warning
Recommended not to run locally — please use Docker instead.
Running locally may lead to dependency conflicts and could affect your system-wide packages or break existing setups.
