html parsers for sites other than Daz3D? Renderosity/Renderotica/Others?

Go down

html parsers for sites other than Daz3D? Renderosity/Renderotica/Others?

Post by CuddleBear on Tue Mar 27, 2018 8:28 pm

Hey, have been using this tool aswell as the C.P.A. but both of them are lacking any metadata scraping around the web.
It would be amazing if we could have a html scraper to scrape either metadata like tags, titles, images and such from sites like Renderosity for example.
They already host all the info out in public with tags and other info useful for the dsx files.
Having a program to do this on the creation of the install zip would remove the need for much of the manual input i would think.
This program is great to do much of the heavy lifting and preparation of the files themselves but its sad that you get stuck manually entering all the info already out there. Esp so when content on the Daz store is automatically filling in the metadata for us to use.

Don't expect something amazing but it would be great if we could choose the classes to be used to what field ourselfs as well, since that allows the users to add more sites for scraping support.
Searching out of a parsed ID in the filename or from a sidecar url link would also speed things up without the need to get the user to paste in the urls manually each time, even though that isnt too bad.

CuddleBear

Posts : 1
Reputation : 0
Join date : 2018-01-05

Back to top Go down

Re: html parsers for sites other than Daz3D? Renderosity/Renderotica/Others?

Post by Admin on Mon Apr 02, 2018 8:08 am

Sorry for the late reply. I actually thought about doing something like that after checking it out each website would have to have it's own HTML parsers because the HTML format isn't the same. And at that time I was working on other options and never got back to it. I'll look into it some more when I get time.

_________________
avatar
Admin
Admin

Posts : 653
Reputation : 11
Join date : 2016-11-16

http://cdds-and-tools.forumotion.com

Back to top Go down

Re: html parsers for sites other than Daz3D? Renderosity/Renderotica/Others?

Post by Akkaal on Sat May 05, 2018 8:31 am

Mathmathou's D.R.A.M.A. app can scrap the DAZ site, and does an amazing job at it. It use to do Renderosity as well, but somethings changes with the rendo site and Mathmathou's MIA atm. It puts the info into a pretty slick database. It does't intergrate with CDDS, but I use the asset page in DRAMA to copy and paste info and pictures into a readme folder with my content before I DIM them in CDDS.

The DRAMA download site is http://www.drama-soft.com/forum/viewtopic.php?f=5&t=20 As I mentioned the programmer is currently MIA so DRAMA is not a finished product but the DAZ HTML scraper works fine.

Akkaal

Akkaal

Posts : 99
Reputation : 0
Join date : 2016-12-14
Age : 48

Back to top Go down

Re: html parsers for sites other than Daz3D? Renderosity/Renderotica/Others?

Post by Sponsored content


Sponsored content


Back to top Go down

Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum