• Options
• Login
• Desktop Style

Reverse DALL-E

• Index

  • The Voynich Ninja
  • Voynich Research
  • Voynich Talk
  • Reverse DALL-E
• Reverse DALL-E

• Reverse DALL-E

  Mark Knowles > 18-12-2023, 11:48 PM

  Does anyone know of software that will take an image and then create a description of that image in words? (Preferably conforming to some overall format or formula.) Ideally this would be applied to multiple separate drawings of plants; isolating features of each plant and also common features.

• RE: Reverse DALL-E

  Scarecrow > 19-12-2023, 07:48 AM

  ChatGPT and BARD as most common "AI" generators can also read images and produce textual description of it.
  
  In ChatGPT you need the plus subscription to use that feature and while it is nice it is maybe yet more funny than great.
  Never tried BARD so cannot comment on that.
  
  Clip/Interrogator is interesting too and it is free. You are not allowed to view links. Register or Login to view.
  Below is what it said about the image here
  
  "a book with a drawing of a tree and a lizard, image apothecary, valerian, hydra, floating kelp, byzantine, l - system, noxious, asymmetrical composition, michellin star, tunic, listing image, colored drawing, spritesheet, medical image, depicting a flower, ponds"

• RE: Reverse DALL-E

  Mark Knowles > 19-12-2023, 06:58 PM

  Ideally I would something formalised, almost a script.
  
  FLOWERS: NO (OR SMALL OR ONE OR ...)
  ROOTS: HAIRY(OR SMOOTH OR ...
  LEAVES: SMOOTH BLUE (OR CURLY OR...)
  
  then I can statistically cross compared plant script text with associated EVA text to see if there are relations between the two. I want the script to be as simple as possible without being too simple. So devising an appropriate script format seems quite difficult.
  
  Of  course a script will not be as flexible to perfectly reproduce the original drawing, nor does it need too. It just needs to describe the core and most significant features.
  
  To select the terms used one needs to compare which are the common features that we see amongst the different herbal drawings.

• RE: Reverse DALL-E

  Koen G > 19-12-2023, 09:35 PM

  Something like that is pretty easy to do by hand. It will take a number of hours but the result will be many times more reliable than what the current generation of AI can produce.

• RE: Reverse DALL-E

  Mark Knowles > 19-12-2023, 10:17 PM

  Colours and Counts might be relevant
  
  RED, GREEN, BROWN, BLUE ...
  
  ONE, TWO, THREE, MANY...
  
  Terms like
  
  BULB, STRAIGHT, CIRCULAR
  
  might be of use
  
  One might want to define a specific common structure with a given name.

• RE: Reverse DALL-E

  Mark Knowles > 19-12-2023, 10:44 PM

  Of course this approach may deliver no useful results. It remains one to be explored.

• RE: Reverse DALL-E

  Mark Knowles > 20-12-2023, 05:59 AM

  Many herbs have unique features so it may not be possible to match these.
• Next Oldest Next Newest