Re: Appsheet server is completely down now...

Koichi_Tsuji · 12-10-2023 05:59 PM

I could not open all the app, and app editor at all. Completly broken, it looks the appsheet server is currently down now.. I m in Japan. Anyone else seeing the same?

@devingu

@takuya_miyai

Kem_Ave

I'm having same issue. It's not completely down, but very slow response. Also, I wasnt able to login with crew tools browser extension for appsheet since Saturday.

Koichi_Tsuji

It seems outage is happening once again....

Swoopy

Me too.

T_I_Phong

Yes, i am having same issue

raihanhere

My goodness! Again and again...

Koichi_Tsuji

It looks like the server is back again. I could manage to open apps now.

DucV

Yes, it works normal for now.

hien_nguyen

From Vietnam. Today Appsheet was working very slowly. Many users feedbacked to me about this issue I also checked my apps are working slowly after clicking the sync button too. Please review this problem. Thanks.

Swoopy

Still no improvement.

baba_sawane

Can't access editor nor sync apps right now too.

Made a report at https://support.google.com/appsheet/gethelp?sjid=562941249826956058-EU

Swoopy

I would avoid editing anything for time being.

hien_nguyen

Syncing very slow more thán a minutes

Swoopy

Right, my apps usually take 3-4 seconds to sync 20,000+ rows.

Wojciech_Redman

Same here! People on production are waiting with their raports! 😩

Rhage

same issue here. from Philippines, it also seems that the AND() function inside select() functions doesn't work.

baba_sawane

Seems to be working again.

Rhage

app syncs now. however some functions are misbehaving as mentioned earlier. Will wait to get resolved before making mor updates on appsheet

takuya_miyai

Hi everyone.
Today, AppSheet needs time to display again.
How about your organization?

@devingu
@Koichi_Tsuji

Wojciech_Redman

Hello,

Here in Poland it's the same... Extremely slow app loading times...

JC12

Hi, same here in the Philippines, we are encountering slow loading time.

baba_sawane

new issue arise, experiencing slow sync times this morning.

isdal

Hi folks,

Thank you for reporting this issue. Our monitoring shows slowness from 9:40pm PDT on Dec 11. It is similar to the event on Dec 10. We are investigating the root cause.

isdal

We have identified a problematic feature that caused high load on our system. That feature is now disabled and the system is rolled back to Thursday's state. Our metrics indicate that error rates returned to normal at 00:50 PST, latencies are down to the regular range at that time as well.

We will do a RCA for this event.

Koichi_Tsuji

@isdal So much amount of the frustation from the users/creators are coming due to such repeated outage. It is not a matter of the duration, the problem is the business applications such as AppSheet is out of use which stops/helt ongoing business.

Plesae review and investigate the case once again to avoid the reoccurance. I have requested the exactly same request before for hundreds of time sadly...

Also the status dashboard is not working and not providing the realtime useful information at all. This dashboard seems to be out of order as well.

KON_TROLL

Soooo true @Koichi_Tsuji !!!

Ratatosk

Same. Have to run save twice to save when developing. Takes a minute each time I try.

Rifad

@Koichi_Tsuji wrote:

Also the status dashboard is not working and not providing the realtime useful information at all. This dashboard seems to be out of order as well.

I use Uptime (formerly Better Uptime) | Better Stack to track the status of apps.

KON_TROLL

Same in Norway. Sync takes 4-5 minutes and only goes through 1 out of 5 times. And saveing in editor has the same issue. Saying: You changes couldent be saved. (no explenation).

BUT: This also happend Friday 3 days ago! Our 800 users were out for 5 hours. This is really not professional...!!! Our users are loosing their patience now... I got 400 emails with errors and complaints this morning!

Dutchfluidtanks

Same in the Netherlands. Sunday and now Tuesday not working. There is no place to look if there is a central issue or what the cause was.

KON_TROLL

Well, with nothing working in Appsheet for 4 hours now, I asume we can all just leave work and go home.....:( This is really costing a lot of money!

KON_TROLL

Lokks normal again in Norway... FINALLY!

T_I_Phong

Almost my apps are not working, too slowly. The first time I see this issue: "-2[-2]"

Koichi_Tsuji

yes, at tihs particular moment, App sync ultra slowly. I suspect another server issue is behind the scene.

baba_sawane

Appsheet team every morning since Monday

isdal

yep! Except it's night for us and an angry pager shaking us awake. Fortunately we now have a very good understanding of the issue so I have high hopes that we finally get some sleep tonight.

We understand how disruptive this is for our customers who rely on AppSheet for their business and we are doing a very detailed RCA to avoid any reoccurrence of this or similar issues.

baba_sawane

Thanks for answering. Fortunately bugs like that are fixed within hours. But I understand they can happen, and eventually not fixed with a single update.

If I can make a suggestion, having info about servers status/on-going investigation would be great. Wether in https://status.cloud.google.com/ , a pinned forum post or a dedicated web page. If we can receive any form of notification when an issue arise, we can inform users and reduce time lost.

isdal

The system should be back to normal as of 23:02 PST. Please contact support if you still see issues. Detailed updates here:

https://www.googlecloudcommunity.com/gc/AppSheet-Q-A/is-there-a-system-failure/m-p/683507/highlight/...

Rifad

@isdal yes its back to normal now. Thanks for the update.

takuya_miyai

Hi @isdal

AppSheet is currently running slowly.
Are you experiencing the same problem phenomenon?

How is it in your environment?