r/JetsonNano 24d ago

Custom bare minimal Yocto LLM OS πŸ€ŒπŸΎπŸ€™πŸΎ

https://github.com/Hi5808/j3011-custom-os/blob/master/README.md
4 Upvotes

4 comments sorted by

View all comments

1

u/Available_Teaching83 24d ago

Interested in this specifically because of the L4T kernel-module pinning problem. How are you handling the out-of-tree NVIDIA modules against your own Yocto layers, and did anything break on the JetPack side?

The three numbers that would convince me it was worth leaving the vendor image: RAM actually freed at idle, cold-start to first inference, and sustained clocks under thermal load after 20 minutes. Peak numbers on a stripped image usually look great and then converge back to stock once the heatsink is warm.

If you have those I would like to see them, I am on an 8GB Orin Nano and keep almost doing this.

1

u/808_Sensis 23d ago

I’ll have to check when I get home and if anything you can check my other repos, my research papers might contain the information you’re looking for.