Current state of the GW2 API (July 2, 2018) — Guild Wars 2 Forums

ArenaNet Forum Chat for September: The next forum conversation, on the topic of our September 18th release -- including Living World Season 4 Episode 4, a new raid, a new legendary, and more -- invites member questions and comments from Tuesday (9/25) through Friday afternoon Pacific Time (9/28). Devs will be responding through early October, as their schedules allow. Join the special September 2018 AFC Subforum to take part. More info here.

Current state of the GW2 API (July 2, 2018)

Hi all,

As many of you have recently noticed, something has gone a bit wrong with the GW2 API system over the past weekend. We had a server fail which was responsible for tracking what sorts of content should be visible via the API. This server watches the game and every time someone picks up an item, unlocks an achievement, plays an event, and so on, it records the ID number of the content and adds it to a whitelist. The whitelist in turn controls what data we show via the API.

The reason for this mechanism is to avoid spoiling content that has not been found by players naturally. The whitelist allows us to safely show data on things players have found in the game, but keep a few things under wraps if they haven't been experienced by anyone yet. Essentially it keeps the API from leaking spoilers for new content.

I mentioned above that the server responsible for this whitelist had a failure. The bottom line is that the whitelist was effectively reset, and every discoverable piece of content in the game has to be re-experienced in order to add it back to the whitelist. Much of the game's data is already visible again, but a chunk of it will be hidden until players come across it in-game one more time.

We are of course trying to restore the whitelist data from backups and other measures. I wanted to share our current status in case those other measures don't pan out.

We're also tracking a number of other issues with the API, including map data availability, intermittent failures of different sorts, and various endpoints being inoperable. These issues are unrelated to this weekend's failure and will be addressed separately.

Thanks,

Tagged:

Comments

  • Thanks for the update. Servers happen :(

    "With great power comes not-so-great utility bills."

  • Elrey.5472Elrey.5472 Member ✭✭

    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

  • WeAreTwO.9780WeAreTwO.9780 Member ✭✭

    Thank you for this helpful update and clarifying things. :)

  • Interesting, thanks for the update! But does that mean the historical achievement category will be forever removed from the API? ;)

  • Wanze.8410Wanze.8410 Member ✭✭✭

    Why does it take so long to fix the the transaction api? Its been 6 months now, since they worked properly.

  • thrag.9740thrag.9740 Member ✭✭✭

    wow, kind of amazing that the game is big enough that the list doesn't return to its pre-failure state quite quickly. Hope it works out for you guys

  • This had the fortunate side effect that those achievements for birthdays 7, 8, 9 and 10 left the API again! Jay! :D

  • Vegeta.2563Vegeta.2563 Member ✭✭✭
    edited July 3, 2018

    @MikeLewis.7496 said:
    Hi all,

    As many of you have recently noticed, something has gone a bit wrong with the GW2 API system over the past weekend. We had a server fail which was responsible for tracking what sorts of content should be visible via the API. This server watches the game and every time someone picks up an item, unlocks an achievement, plays an event, and so on, it records the ID number of the content and adds it to a whitelist. The whitelist in turn controls what data we show via the API.

    The reason for this mechanism is to avoid spoiling content that has not been found by players naturally. The whitelist allows us to safely show data on things players have found in the game, but keep a few things under wraps if they haven't been experienced by anyone yet. Essentially it keeps the API from leaking spoilers for new content.

    I mentioned above that the server responsible for this whitelist had a failure. The bottom line is that the whitelist was effectively reset, and every discoverable piece of content in the game has to be re-experienced in order to add it back to the whitelist. Much of the game's data is already visible again, but a chunk of it will be hidden until players come across it in-game one more time.

    We are of course trying to restore the whitelist data from backups and other measures. I wanted to share our current status in case those other measures don't pan out.

    We're also tracking a number of other issues with the API, including map data availability, intermittent failures of different sorts, and various endpoints being inoperable. These issues are unrelated to this weekend's failure and will be addressed separately.

    Thanks,

    None of the Living World Season 4 maps have ever had map tiles, and they have been discovered by 1000's of players. Nor has the world map ever been expanded to show these areas. The bottom of this image is the current cut off for the API, and it hasn't been updated since the end PoF release.

  • Jink.6571Jink.6571 Member

    Is it supposed to be stable now?
    More often then not it works but I still get connection resets, 404 not founds etc from time to time -_-

    @Elrey.5472 said:
    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

    Is there a chance you can upload it somewhere? Not having stable access to items sucks =(

  • Please update the api and give the game some new life. Been wanting to see the value of my black lion mounts on gw2efficiency for some time now.

  • Leablo.2651Leablo.2651 Member ✭✭✭

    @Jink.6571 said:
    Is it supposed to be stable now?
    More often then not it works but I still get connection resets, 404 not founds etc from time to time -_-

    @Elrey.5472 said:
    Oh dear. Thanks god I downloaded the entire Items database 1 month ago for local use xD.

    I hope you get it fixed.

    Is there a chance you can upload it somewhere? Not having stable access to items sucks =(

    Most API sites are running off a local db, you can probably find an export list from one of them.

  • Five days and still down. Do we have an estimated time on when this will be resolved? Thanks

  • It would be nice if you could update the "Tile Service" as well.

    Obviously give it a little more time not to spoil this latest story update, but then bring it up to the current status :)

  • Still down? can't get gw2timer.com to work :(

  • Is it still down? I get the "The official GW2 API is experiencing issues" message from sites like MetaBattle or SnowCrows. But some people have posted screenshots where it seems to work fine for them. IDK.

  • queicherius.2563 has made a good overview of which endnode is not working: https://status.gw2efficiency.com
    But atm it seems that everything is working.

  • Okay it seems like it works in other browsers for me, but It's not working in Firefox for some reason. I tried clearing cache and cookies, but nope.

  • Neutra.6857Neutra.6857 Member ✭✭✭
    edited July 21, 2018

    Not sure when it happened but my current transactions have updated in efficiency.

  • Is there a threshold number of players who have to "pick up" an item before it becomes whitelisted? I've got items on my own characters that I've unequipped/looked at/re-equipped in game, but still get invalid IDs returned from the API in the items endpoint. Is there some other mechanism of getting my own stuff whitelisted?

  • I wonder. am I right that it was your forceful rollback to backup that fixed Buy/Sell APIs? I've waited for more than half a year for the fix and now they work fine.
    If this is the case - well, bad job.

  • Illconceived Was Na.9781Illconceived Was Na.9781 Member ✭✭✭✭
    edited August 3, 2018

    @DarkMagister.7429 said:
    I wonder. am I right that it was your forceful rollback to backup that fixed Buy/Sell APIs? I've waited for more than half a year for the fix and now they work fine.
    If this is the case - well, bad job.

    From the dev's post on the topic:

    We had a server fail which was responsible for tracking what sorts of content should be visible via the API.

    "With great power comes not-so-great utility bills."

  • @Khayman Alisti.3260 said:
    Is there a threshold number of players who have to "pick up" an item before it becomes whitelisted? I've got items on my own characters that I've unequipped/looked at/re-equipped in game, but still get invalid IDs returned from the API in the items endpoint. Is there some other mechanism of getting my own stuff whitelisted?

    I've done the same. So perhaps the WhiteListing functions are stalled or it happens less quickly than we think. I know some of the devs were in favor of keeping e.g. mystic forge recipes hidden for long enough that early discoverers would get a chance to profit (not a policy with which I agree, but perhaps it affected how quickly things white list automatically).

    "With great power comes not-so-great utility bills."

  • Malediktus.9250Malediktus.9250 Member ✭✭✭✭

    The amount of care Anet spends on the API is just appalling. Indie garage company level

    First person to reach 35,000 and 36,000 AP.
    killproof.me/proof/kEyr

  • @Illconceived Was Na.9781 said:
    From the dev's post on the topic:

    We had a server fail which was responsible for tracking what sorts of content should be visible via the API.

    What I have written about is Current Buys/Sells have not been working since winter and anet didn't really care.
    Now their server crashed, they have rolled back to some backup and those endpioints work again.
    I have a feeling nowone even looked into that problem for all this time, despite al the forum requests and the rollback just ocasionally fixed it.

  • Unholey.3264Unholey.3264 Member ✭✭
    edited August 6, 2018

    Did the wardrobe API get reset again? Looking at it on efficiency now and there's verrrry little showing.

    Edit: Nvm, seems normal now.

  • Still can't API my own items. Any news, devs?

  • Bumpity-bump-bump.

©2010–2018 ArenaNet, LLC. All rights reserved. Guild Wars, Guild Wars 2, Heart of Thorns, Guild Wars 2: Path of Fire, ArenaNet, NCSOFT, the Interlocking NC Logo, and all associated logos and designs are trademarks or registered trademarks of NCSOFT Corporation. All other trademarks are the property of their respective owners.