Skip to content

Controller Crash & A Naive Solution #99

Open
@AronCao49

Description

@AronCao49

Hi, I recently try to install benchbot on two host machine. For the first one with 3070, the benchbot works smoothly. However, when I try to run the same command on the second machine with 4080, similar controller crashing as #92 happens. Specifically, the Isaac Sim window pops up at the first time holding for like 10 sec, then vanishes as soon as the starting the robot controller is "Ready".

I takes some time trying to fix this issue following some potential solutions from #92 but none of them work. Fortunately, somehow when I try to full screen the Issac Sim window and maximises the Console window to check its output...the Issac Sim survives!

Although it sounds a bit silly, I give quiet a few testing rounds and the Issac Sim window is successfully preserved for each round, which is also able to be used to conduct the exemplary demo like "hello_passive" provided. Shortly speaking, the key is to hide the Viewport window when initializing the Isaac Sim, like the screen shot below:

Screenshot from 2023-05-12 13-17-28

Comparing the console outputs from 3070 and 4080, the issue may lie upon two Error message:

Screenshot from 2023-05-12 10-35-40

which I can only find on 4080 but not 3070, possiblely causing the controller crash.

There are also some outputs from the console that are different. I will attach the screenshot for further discussion. The specifications of my host machines can be found below also.

  1. 3070 spec
Core host system checks:
	Ubuntu version >= 20.04:                                  Passed (20.04)

Running Nvidia related system checks:
	NVIDIA GPU available:                     Found card of type '10de:2484'
	NVIDIA driver is running:                                          Found
	NVIDIA driver version valid:                           Valid (530.30.02)
	NVIDIA driver from a standard PPA:                          PPA is valid
	CUDA drivers installed:                                    Drivers found
	CUDA drivers version valid:                          Valid (530.30.02-1)
	CUDA drivers from the NVIDIA PPA:                           PPA is valid
	CUDA is installed:                                            CUDA found
	CUDA version valid:                                         Valid (12.1)
	CUDA is from the NVIDIA PPA:                                PPA is valid

Running Docker related system checks:
	Docker is available:                                               Found
	Docker version valid:                                   Valid (20.10.12)
	NVIDIA Container Toolkit installed:                       Found (1.13.1)
	Docker runs without root:                                         Passed

Running checks of filesystem used for Docker:
	/var/lib/docker on ext4 filesystem:                      Yes (/dev/sdb6)
	/var/lib/docker supports suid:                                   Enabled
	/var/lib/docker drive space check:               Sufficient space (203G)

Miscellaneous requirements:
	Pip python package manager available:                     Found (21.3.1)
	Tkinter for Python installed:                                      Found
	PIL (with ImageTk) for Python install                              Found

Manual installation steps for Omniverse-powered Isaac Sim:
	License accepted for Omniverse:                                      Yes
	Access to nvcr.io Docker registry:                                   Yes
  1. 4080 spec
Core host system checks:
	Ubuntu version >= 20.04:                                  Passed (20.04)

Running Nvidia related system checks:
	NVIDIA GPU available:                     Found card of type '10de:2704'
	NVIDIA driver is running:                                          Found
	NVIDIA driver version valid:                           Valid (530.30.02)
	NVIDIA driver from a standard PPA:                          PPA is valid
	CUDA drivers installed:                                    Drivers found
	CUDA drivers version valid:                          Valid (530.30.02-1)
	CUDA drivers from the NVIDIA PPA:                           PPA is valid
	CUDA is installed:                                            CUDA found
	CUDA version valid:                                         Valid (12.1)
	CUDA is from the NVIDIA PPA:                                PPA is valid

Running Docker related system checks:
	Docker is available:                                               Found
	Docker version valid:                                     Valid (23.0.6)
	NVIDIA Container Toolkit installed:                       Found (1.13.1)
	Docker runs without root:                                         Passed

Running checks of filesystem used for Docker:
	/var/lib/docker on ext4 filesystem:                      Yes (/dev/sda1)
	/var/lib/docker supports suid:                                   Enabled
	/var/lib/docker drive space check:               Sufficient space (785G)

Miscellaneous requirements:
	Pip python package manager available:                     Found (23.1.2)
	Tkinter for Python installed:                                      Found
	PIL (with ImageTk) for Python install                              Found

Manual installation steps for Omniverse-powered Isaac Sim:
	License accepted for Omniverse:                                      Yes
	Access to nvcr.io Docker registry:
  1. 3070 Isaac Sim Console Output:
    3070_Isaac_Sim_Output

  2. 4080 Isaac Sim Console Output:
    4080_Isaac_Sim_Output

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions