Umeå universitets logga

umu.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Predicting Gripability Heatmaps using Conditional GANs
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för fysik. (Digital Physics)ORCID-id: 0000-0002-6811-2776
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för fysik. (Digital Physics)ORCID-id: 0000-0002-0787-4988
2021 (Engelska)Rapport (Övrigt vetenskapligt)
Abstract [en]

The feasibility of using conditional GANs (Generative Adversarial Networks) to predict gripability in log piles is investigated. This is done by posing gripability heatmap prediction from RGB-D data as an image-to-image translation problem. Conditional GANs have previously achieved impressive results on several image-to-image translation tasks predicting physical properties and adding details not present in the input images. Here, piles of logs modelled as sticks or rods are generated in simulation, and groundtruth gripability maps are created using a simple algorithm streamlining the datacollection process. A modified SSIM (Structural Similarity Index) is used to evaluate the quality of the gripability heatmap predictions. The results indicate promising model performance on several different datasets and heatmap designs, including using base plane textures from a real forest production site to add realistic noise in the RGB data. Including a depth channel in the input data is shown to increase performance compared to using pure RGB data. The implementation is based on the general Pix2Pix network developed by Isola et al. in 2017. However, there is potential to increase performance and model generalization, and the adoption of more advanced loss functions and network architectures are suggested. Next steps include using terrains reconstructed from highdensity laser scans in physics-based simulation for data generation. A more in-depth discussion regarding the level of sophistication required in the gripability heatmaps should also be carried out, along with discussions regarding other specifications that will be required for future deployment. This will enable derivation of a tailored gripability metric for ground-truth heatmap generation, and method evaluation on less ideal data.

Ort, förlag, år, upplaga, sidor
Umeå: Umeå universitet , 2021. , s. 29
Serie
Technical Report
Nationell ämneskategori
Datorgrafik och datorseende
Forskningsämne
datoriserad bildanalys
Identifikatorer
URN: urn:nbn:se:umu:diva-190758OAI: oai:DiVA.org:umu-190758DiVA, id: diva2:1622970
Tillgänglig från: 2021-12-27 Skapad: 2021-12-27 Senast uppdaterad: 2025-02-07Bibliografiskt granskad

Open Access i DiVA

fulltext(4143 kB)721 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 4143 kBChecksumma SHA-512
0aae3fad79f896530356b9412b983ec970f0ce393f08b773bedc5dfceacb84011c4ed02fca47e84152f6b98dfa84ace733d46e892a1fe91a4be08dc0b1491b52
Typ fulltextMimetyp application/pdf

Person

Andersson, JenniferServin, Martin

Sök vidare i DiVA

Av författaren/redaktören
Andersson, JenniferServin, Martin
Av organisationen
Institutionen för fysik
Datorgrafik och datorseende

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 722 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 700 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf