darksonny wrote:Thank you dude, its a huge effort making this nice collection project! and many of the maps does have some picture to preview it before downloading them. Could be nice (maybe this is a wip process or still unfinished task) all maps could have any pic mainly those funny author who posted a nonrelated preview of his map (pictures like bugsbunny or the logo clan, those are they uselees info that does not helps ut fan to decide wether download or not).
The map pics are extracted automarically directly from the Screenshot property set in the map's LevelInfo. Unfortunately if they didn't put a picture in there, there will be no pic. I can't play 30 000 maps and take screenshots of all of them unfortunately
. Sometimes, if the author put some .jpg or other images in the archive, it will automatically use those too, which is why some maps seem to have a lot of screenshots while others only have one.
I noticed you didn't got all mapping contest packs from UT99.org ...I pinned them to our mapping Discord channel.
https://discordapp.com/channels/2267363 ... 7467059205
(the pin symbol on the right upper corner)
If you prefer those downloads via dropbox PM me and I upload them there.
Thanks. I actually downloaded the individual maps when the contest happened, just hadn't added them yet. You'll note that the lead image for "Map packs" on the side actually contains all the contest entries
. Seemed appropriate.
I've added the pack now
, but I haven't looked at how to classify BRUT yet so its not there individually but I'll figure it out.
I probably need to talk with you about uploading my stuff and what gets uploaded. Over the years I've siteripped everything I could get into and downloaded all the files I ever came in contact with. The things explicitly sent to me to private test I've always placed in a distinct folder so I didn't mistakenly share them but the ripped stuff contains all kinds of unreleased content, beta files, test versions, etc. There's for sure things in there that were not meant to be public but I don't know which is which. I just saved everything.
What are your feelings about files like this? Do you want to just mirror everything and remove stuff if the author gets upset? I can work through it and guess at what should be archived safely but if I do that the community will lose out on a bunch of content that's valuable to learn from as well as history of mod development. I also have a lot of anticheat sources and aimbots, etc. What about those? What about bytehacked files? It can all get a little muddy depending on the level of 'community archive' you want to host.
If you want to discuss this privately just drop me an email. I'll explain more in depth what I have saved. The easiest way to visualize it is that many websites owners are gamers and not web designers. The majority of them think that their files are private when they aren't and someone with a crawler is able to grab all over them. Which I did. A lot.
As mentioned, thanks for prompting this whole thing. I really got me thinking, and this is currently the result.
I know what you mean about finding stray stuff
. I found myself in forgotten university FTP servers probably left over from when people used to play UT there, probably accidental Apache auto-index lists, etc, and was able to find stuff
. I can't complain, it was certainly helpful
With regards to the files you have though, I'd be interested in grabbing as much of it as possible and then indexing what I can for the archive. If there are random .uz files, or other things that don't look like packaged/released things, my indexer will pass them over, but slurp up everything else it can identify. Its probably easiest if I could download it form you somehow, I haven't had much luck having people upload to me (too slow). I'll PM you this weekend and we can discuss.
It still lacks some content, which is to be expected at this stage, but that will certainly come with time and community contributions.
I also intend to do something similar, but in a different way and a lot more selective on the actual content to serve, but unfortunately I was unable to advance with it thus far, and for the time being, repositories like this one is something really needed, the more redundancy of these places we have, the less likely it is for anything of worth to be lost forever.
As far as lack of content goes, it's definitely lacking a lot of the more recent stuff (and definitely a lot of old still). I've focused on just scraping as many of the existing repositories as possible, which mostly contain things from up to a few years ago. It seems newer stuff is either "released" directly into caches on servers, or as forum attachments/dropbox uploads, which makes collecting it rather difficult.
Once I get uploads figured out, hopefully things will improve and people can submit their own back-catalogs
When you build your own thing, even if it has better curated or more selective content, feel free to make use of the metadata or steal package reading code, images, file lists, etc if it seems to be of use to you.
FraGnBraG wrote:how did you populate the meta-data? I wonder since - for example - there are several maps with "unknown" for the author (including one of mine), and what looks like a "guess" at release date of maps... long ago there was a euro fella who created a monster site that was highly auto-magic (varpu fyi) ... this makes me think of that a bit...
So, for maps, the authors are pulled directly from the LevelInfo within the maps using my Unreal Engine package reading library (https://github.com/shrimpza/unreal-package-lib
). "Unknown" authors typically happen if I can't read the properties form LevelInfo for whatever reason (bugs
), or there are no names (seem to be a lot of maps people don't fill out that info). For content that's not maps, where no LevelInfo or dedicated "Author" information is available, I try to look in README files, which generally results in a bit of a mess, but does sometimes get it right. Release dates are definitely guesses - the best approach I found was simply to use the modification date of the content/map/etc. So if someone modified your map, or anything else changed the last modification date (like it was zipped by someone whose system time was wrong), you'll get an inaccurate date.
Please let me know if you spot incorrect authors (just send me links to the content page, and the correct author name), I'll happily correct them
. This will definitely help for when I build the "Browse by Authors" page.