Database updates delayed

I stumbled over a serious error in the data processing software that caused parts of the data uploaded during the last 7 weeks not to be included in the main database. Fortunately I can fix this by reprocessing these parts, but since that's a whole lot of information it'll take some time.

I have suspended the regular data parsing and database update process. Don't worry, nothing uploaded right now will get lost, it'll just be processed and included a little bit later.

[edit] The reprocessing procedure will take way longer than I expected. I will therefore try to run both processes in parallel. There will probably still be delays in the database updates, but there will at least be any updates during the next days.
This entry was posted by Slarti on Sunday, October 7. 2007 at 23:45. You can leave a response, or trackback from your own blog.

Trackbacks

Trackback specific URI for this entry

    No Trackbacks

Comments

Display comments as (Linear | Threaded)

  1. Markus says:
    #1 2007-10-09 12:40 (Reply)

    What a great Project Slarti.

    Even i haven't tried it yet, i've read thru all your Blog to get a feel for it.

    Some Questions...

    you stated that, the private Server Users have caused you headache, with their faulty data.
    Why don't you just check for the Version Number of WoW and disable all gathering for anything that is not near to Recent Version to solve that problem.

    Since i didn't tried it yet at home: Is there any problem if i switch my Language between German/English with WoW. Meaning, could the data i gather be put into the wrong data for you.

    And the Last Question, how do you finance this whole Project? SpeedyDragon shows no advertisement, at all.

    I would maybe be willing to Donate for this Project. You should include some Options for the people who use your service.

    I'm exited to go home and try the Addon in my WoW tonight.

  2. Markus says:
    #2 2007-10-09 13:48 (Reply)

    Ooops, just noticed the Donate information while downloading the Database the first time.

  3. Slarti says:
    #3 2007-10-09 13:56 (Reply)

    Actually any data uploaded is being filtered before processing using several attributes, one of them being the WoW version. And there are adaptive filters in place that try to detect faulty data as it is being processed. I guess I get about 99.9% of private server data this way, but I wouldn't have to deal with it in the first place if the private server users would realize that they're polluting the database with their "could-be-anything"-data and just stop uploading it.

    If you switch your language the gathered data store is being erased the next time you log in using the new language to prevent english data from being mistaken as german and the other way round.

    And the last question: MobMap is being financed entirely by donations (you see the donation options when you download anything from the website). SpeedyDragon is not that well-known yet to cause me too many financial hassles, but I'll probably add some ads once I get to that point.

  4. Deathwing says:
    #4 2007-10-09 22:48 (Reply)

    Sorry this is kinda off topic of the subject but i have a suggestion to make about MobMap.
    What if you asked wow.allakhazam.com if you could use their database for MobMap.

  5. Slarti says:
    #4.1 2007-10-10 02:57 (Reply)

    Why should I? I've got my own data collection and processing system up and running, and thanks to many voluntary uploaders out there it's gathering more data all the time to fill some still-existing holes and include new content.

    Or the better question probably would be: why should any other database site give me their database? That's one of their most valuable assets, and since each and every database site out there strives to make money from their site visitors they probably won't be too excited at the prospect of giving their whole database away to someone who'd use it for an addon that makes it less necessary to visit their sites.

    And I haven't even started to talk about the technical problems of integrating complex, heterogeneous databases...no, I definitely prefer independence.


Add Comment


Enclosing asterisks marks text as bold (*word*), underscore are made via _word_.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA 1CAPTCHA 2CAPTCHA 3CAPTCHA 4CAPTCHA 5