Current state of the GW2 API (July 2, 2018) — Guild Wars 2 Forums

Current state of the GW2 API (July 2, 2018)

Hi all,

As many of you have recently noticed, something has gone a bit wrong with the GW2 API system over the past weekend. We had a server fail which was responsible for tracking what sorts of content should be visible via the API. This server watches the game and every time someone picks up an item, unlocks an achievement, plays an event, and so on, it records the ID number of the content and adds it to a whitelist. The whitelist in turn controls what data we show via the API.

The reason for this mechanism is to avoid spoiling content that has not been found by players naturally. The whitelist allows us to safely show data on things players have found in the game, but keep a few things under wraps if they haven't been experienced by anyone yet. Essentially it keeps the API from leaking spoilers for new content.

I mentioned above that the server responsible for this whitelist had a failure. The bottom line is that the whitelist was effectively reset, and every discoverable piece of content in the game has to be re-experienced in order to add it back to the whitelist. Much of the game's data is already visible again, but a chunk of it will be hidden until players come across it in-game one more time.

We are of course trying to restore the whitelist data from backups and other measures. I wanted to share our current status in case those other measures don't pan out.

We're also tracking a number of other issues with the API, including map data availability, intermittent failures of different sorts, and various endpoints being inoperable. These issues are unrelated to this weekend's failure and will be addressed separately.

Thanks,

Tagged:

Comments

  • Thanks for the update. Servers happen :(

    "With great power comes not-so-great utility bills."

  • Elrey.5472Elrey.5472 Member ✭✭

    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

  • WeAreTwO.9780WeAreTwO.9780 Member ✭✭

    Thank you for this helpful update and clarifying things. :)

  • Interesting, thanks for the update! But does that mean the historical achievement category will be forever removed from the API? ;)

  • Wanze.8410Wanze.8410 Member ✭✭✭

    Why does it take so long to fix the the transaction api? Its been 6 months now, since they worked properly.

  • thrag.9740thrag.9740 Member ✭✭✭

    wow, kind of amazing that the game is big enough that the list doesn't return to its pre-failure state quite quickly. Hope it works out for you guys

  • This had the fortunate side effect that those achievements for birthdays 7, 8, 9 and 10 left the API again! Jay! :D

  • Vegeta.2563Vegeta.2563 Member ✭✭✭
    edited July 3, 2018

    @MikeLewis.7496 said:
    Hi all,

    As many of you have recently noticed, something has gone a bit wrong with the GW2 API system over the past weekend. We had a server fail which was responsible for tracking what sorts of content should be visible via the API. This server watches the game and every time someone picks up an item, unlocks an achievement, plays an event, and so on, it records the ID number of the content and adds it to a whitelist. The whitelist in turn controls what data we show via the API.

    The reason for this mechanism is to avoid spoiling content that has not been found by players naturally. The whitelist allows us to safely show data on things players have found in the game, but keep a few things under wraps if they haven't been experienced by anyone yet. Essentially it keeps the API from leaking spoilers for new content.

    I mentioned above that the server responsible for this whitelist had a failure. The bottom line is that the whitelist was effectively reset, and every discoverable piece of content in the game has to be re-experienced in order to add it back to the whitelist. Much of the game's data is already visible again, but a chunk of it will be hidden until players come across it in-game one more time.

    We are of course trying to restore the whitelist data from backups and other measures. I wanted to share our current status in case those other measures don't pan out.

    We're also tracking a number of other issues with the API, including map data availability, intermittent failures of different sorts, and various endpoints being inoperable. These issues are unrelated to this weekend's failure and will be addressed separately.

    Thanks,

    None of the Living World Season 4 maps have ever had map tiles, and they have been discovered by 1000's of players. Nor has the world map ever been expanded to show these areas. The bottom of this image is the current cut off for the API, and it hasn't been updated since the end PoF release.

  • Jink.6571Jink.6571 Member

    Is it supposed to be stable now?
    More often then not it works but I still get connection resets, 404 not founds etc from time to time -_-

    @Elrey.5472 said:
    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

    Is there a chance you can upload it somewhere? Not having stable access to items sucks =(

  • Please update the api and give the game some new life. Been wanting to see the value of my black lion mounts on gw2efficiency for some time now.

  • Leablo.2651Leablo.2651 Member ✭✭✭

    @Jink.6571 said:
    Is it supposed to be stable now?
    More often then not it works but I still get connection resets, 404 not founds etc from time to time -_-

    @Elrey.5472 said:
    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

    Is there a chance you can upload it somewhere? Not having stable access to items sucks =(

    Most API sites are running off a local db, you can probably find an export list from one of them.

  • Five days and still down. Do we have an estimated time on when this will be resolved? Thanks

  • It would be nice if you could update the "Tile Service" as well.

    Obviously give it a little more time not to spoil this latest story update, but then bring it up to the current status :)

  • Still down? can't get gw2timer.com to work :(

  • Is it still down? I get the "The official GW2 API is experiencing issues" message from sites like MetaBattle or SnowCrows. But some people have posted screenshots where it seems to work fine for them. IDK.

  • queicherius.2563 has made a good overview of which endnode is not working: https://status.gw2efficiency.com
    But atm it seems that everything is working.

  • Okay it seems like it works in other browsers for me, but It's not working in Firefox for some reason. I tried clearing cache and cookies, but nope.

  • Neutra.6857Neutra.6857 Member ✭✭✭
    edited July 21, 2018

    Not sure when it happened but my current transactions have updated in efficiency.

  • Is there a threshold number of players who have to "pick up" an item before it becomes whitelisted? I've got items on my own characters that I've unequipped/looked at/re-equipped in game, but still get invalid IDs returned from the API in the items endpoint. Is there some other mechanism of getting my own stuff whitelisted?

  • I wonder. am I right that it was your forceful rollback to backup that fixed Buy/Sell APIs? I've waited for more than half a year for the fix and now they work fine.
    If this is the case - well, bad job.

  • Illconceived Was Na.9781Illconceived Was Na.9781 Member ✭✭✭✭
    edited August 3, 2018

    @DarkMagister.7429 said:
    I wonder. am I right that it was your forceful rollback to backup that fixed Buy/Sell APIs? I've waited for more than half a year for the fix and now they work fine.
    If this is the case - well, bad job.

    From the dev's post on the topic:

    We had a server fail which was responsible for tracking what sorts of content should be visible via the API.

    "With great power comes not-so-great utility bills."

  • @Khayman Alisti.3260 said:
    Is there a threshold number of players who have to "pick up" an item before it becomes whitelisted? I've got items on my own characters that I've unequipped/looked at/re-equipped in game, but still get invalid IDs returned from the API in the items endpoint. Is there some other mechanism of getting my own stuff whitelisted?

    I've done the same. So perhaps the WhiteListing functions are stalled or it happens less quickly than we think. I know some of the devs were in favor of keeping e.g. mystic forge recipes hidden for long enough that early discoverers would get a chance to profit (not a policy with which I agree, but perhaps it affected how quickly things white list automatically).

    "With great power comes not-so-great utility bills."

  • @Illconceived Was Na.9781 said:
    From the dev's post on the topic:

    We had a server fail which was responsible for tracking what sorts of content should be visible via the API.

    What I have written about is Current Buys/Sells have not been working since winter and anet didn't really care.
    Now their server crashed, they have rolled back to some backup and those endpioints work again.
    I have a feeling nowone even looked into that problem for all this time, despite al the forum requests and the rollback just ocasionally fixed it.

  • Unholey.3264Unholey.3264 Member ✭✭
    edited August 6, 2018

    Did the wardrobe API get reset again? Looking at it on efficiency now and there's verrrry little showing.

    Edit: Nvm, seems normal now.

  • Still can't API my own items. Any news, devs?

  • Bumpity-bump-bump.

  • @MikeLewis.7496 If it is helpful, here is a list of some residual ids that were previously white listed but are no longer. I believe they cover everything missing for skins/minis and gliders.

    Skins

    Glorious Hero's Gauntlets (5600)
    Glorious Hero's Legplates (5604)
    Shackles of Madness (6273)
    Shackles of Madness (6414)
    Shackles of Madness (6487)
    Carnival Mace (6941)
    Hawk Trident (4985)
    Mistbreaker (5898)
    Shadow Assassin Short Bow (6072)
    Warden Harpoon Gun (4299)
    Worn Voltaic Spear (4854)
    Mad Memoires: Complete Ignition (7775)
    Crimson Assassin Backpack Cover (7201)
    Hellfire Backguard (6253)
    Radiant Backguard (6353)

    Minis

    Mini Arctodus Cub (147)
    Mini Black Bear Cub (148)
    Mini Snow Cougar Cub (153)
    Miniature Ram (317)
    Mini Dolyak Calf (212)
    Mini Amber Great Jungle Wurm (216)
    Mini Cobalt Great Jungle Wurm (218)
    Mini Crimson Great Jungle Wurm (215)
    Mini Candy Corn Skritt (208)
    Mini Mad King Head (299)
    Miniature Glowing Bat (229)
    Chainsaw the Skeleton (111)
    Mini Ghost Carlotta (200)
    Mini Gwynefyrdd (302)
    Mini Halloween Gourdon (603)
    Mini Husk-o-Lantern (345)
    Mini Lord Humphrey Faren (608)
    Mini Oxidecimus the Shadow Raven (418)
    Mini Mushroom Stomper (331)
    Mini Risen Brute (190)
    Mini Risen Plague Carrier (191)
    Mini Risen Thrall (189)
    Mini First Mate Horrik (163)
    Mini Risen Abomination (192)
    Mini Braham Eirsson (313)
    Mini Frostbite (182)
    Miniature Belinda Delaqua (308)
    Mini Elegant Gold Llama (481)
    Mini Fancy Gold Llama (480)
    Mini Lavish Gold Llama (484)
    Mini Air Djinn (572)
    Mini Earth Djinn (505)
    Mini Water Djinn (503)
    Mini Chieftain Utahein (296)
    Mini Svanir (295)
    Mini Festive Lord Faren (309)
    Mini Frozen Tik'Teek (630)
    Mini Gift Box Gourdon (636)
    Mini Tixx (632)
    Mini Blue Drake Hatchling (328)
    Mini Lunar "Horse" (647)
    Mini Lunar Gourdog (651)
    Mini Lunar Shepherd (650)
    Hexed Outfit (12)

    Gliders

    Griffon Hatchling Glider (56)

  • @MikeLewis.7496 I made a List of missing item ids. I made a request of all item ids against https://api.guildwars2.com/v2/items and got this answere. Then I went through every entry in my database that I fetched in the past from the official API and tried to find the id in the array. I found out, that 8762 items are missing currently.
    I made a List with the items: https://pastebin.com/e3egH4Kf
    And a list with all the ids comma separated: https://pastebin.com/HNUaHwN0
    There are many items, which should have been aquired since the database was deleted.

    Maybe it will help too.

  • I've had some issues with missing item IDs as well, specifically 42424, 42426 and 62897.
    They all seem to be in WeAreTwO's list of missing item IDs.

  • Hello all, I am new to this forum and to using the API, though not new to the game. I have notice a few items missing (older items at that) when requesting them and I see they are listed in WeAreTw0 list along with a bunch of others. Is it known if the resolution for the missing items list will be sooner rather than later or at all?

This discussion has been closed.
©2010–2018 ArenaNet, LLC. All rights reserved. Guild Wars, Guild Wars 2, Heart of Thorns, Guild Wars 2: Path of Fire, ArenaNet, NCSOFT, the Interlocking NC Logo, and all associated logos and designs are trademarks or registered trademarks of NCSOFT Corporation. All other trademarks are the property of their respective owners.