hskohli

hskohli

DeepStream on JetsonNano for live Detection and Segmentation

We are looking to hire a freelancer to design the complete pipeline for the following problem statement:

Hardware to be used:
Jetson Nano

PipeLine:
DeepStream

Problem Statement and Solution required:
We feed one clothing at a time on the conveyor belt. We have a camera installed at top of the conveyor belt. The ultimate aim is to extract a dominant color of each piece of cloth on the live stream. We want to implement this solution on Jetson Nano using their DeepStream pipeline.

We suggest following framework:

  1. The live stream should do ‘object detection’ and tracking of each individual cloth.
  2. After detection and unique tracking, we should perform ‘segmentation’.
  3. We should then find out the dominant color from the ‘segmented’ region of interest.

Data that will be provided by us:

  • Over 6,000 images annotated for ‘object detection’.
  • Over 6,000 images annotated for ‘segmentation’.

Suggestions:

  1. For better training the annotated data can be increased by image augmentation, both for the ‘detection’ and ‘segmentation’. Our image data is currently on CVAT.
  2. Since we want to use Jetson Nano, we suggest we implement the complete pipeline using DeepStream.
  3. We suggest that we use Yolo v5 for the ‘detection’ (or any other model with high accuracy and less computational cost which is compatible with DeepStream).
  4. We should find out the most suitable ‘segmentation’ model compatible with Jetson Nano (and DeepStream).
  5. Since we want to do live ‘detection’ and ‘segmentation’ of clothes on conveyor belt, we suggest that we use tracking module available in DeepStream. The tracking module of DeepStream gives a unique ID to object during the live detection. Since, the ‘segmentation’ models are generally computationally expensive, therefore, it is recommended that a cloth with a ‘unique id’ is ‘segmented’ only once.
  6. Once the clothes are segmented then we can apply a filter on the segmented region to make the image blurry and then use any library (amongst many libraries available on GitHub) to extract the most dominant color (RGB Value) from the region-of-interest (that is the segmented region of the cloth).

We are looking for someone who can implement this project start-to-end including:

  1. Implementing DeepStream Pipeline
  2. Object Detection – Augment the existing annotated images (over 6000 images), train the model Yolo v5 (or any other model that works with DeepStream with high accuracy and FPS).
  3. Segmentation– Augment the existing annotated images (over 6000 images), train the Segmentation model that works with DeepStream with low computational cost.
  4. Convert object detection and segmentation models to Tensor RT or RTX (or any other solution) to make them work with DeepStream with live camera feed.
  5. Implement tracking on DeepStream.
  6. Dominant Color Extraction - The detected cloth with a unique ID should be segmented once and then dominant color from the segmented region should be extracted (a lot of codes are available on Github for dominant color detection).

Remote access to the Jetson device will be provided to you, as and when required.

Kindly provide your best quote and the timeframe required for the same and feel free to reach out to us for further details about the project/models/dataset.

Where Next?

Popular General Dev topics Top

Devtalk
Our jobs section is for full-time paid positions and for companies to post their own jobs (no consultancies or agencies, sorry!) - simply...
New
hskohli
We are looking to hire a freelancer to design the complete pipeline for the following problem statement: Hardware to be used: Jetson Na...
New
Sylvia
About talentbay Our online networking platform connects students with teams in business and industry. It consists of our mobile app for ...
New

Other popular topics Top

brentjanderson
Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...
New
AstonJ
poll poll Be sure to check out @Dusty’s article posted here: An Introduction to Alternative Keyboard Layouts It’s one of the best write-...
New
AstonJ
I’ve been hearing quite a lot of comments relating to the sound of a keyboard, with one of the most desirable of these called ‘thock’, he...
New
PragmaticBookshelf
Rust is an exciting new programming language combining the power of C with memory safety, fearless concurrency, and productivity boosters...
New
Exadra37
I am asking for any distro that only has the bare-bones to be able to get a shell in the server and then just install the packages as we ...
New
DevotionGeo
The V Programming Language Simple language for building maintainable programs V is already mentioned couple of times in the forum, but I...
New
AstonJ
Saw this on TikTok of all places! :lol: Anyone heard of them before? Lite:
New
First poster: joeb
The File System Access API with Origin Private File System. WebKit supports new API that makes it possible for web apps to create, open,...
New
AstonJ
This is a very quick guide, you just need to: Download LM Studio: https://lmstudio.ai/ Click on search Type DeepSeek, then select the o...
New
Fl4m3Ph03n1x
Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...
New