The Feed is down
Not sure what's up (down) but the devs are aware of the problem and will no doubt fix it pronto.
We will get back our missing feed posts at some point in the future right? Just want to make sure that they're not gone forever. :)
First of all,
Thank you so much for everyone (Krink especially) who is making all the efforts they are making to fix this feed issue.
I wanted to mention that I got back all my followers and following people and I am really happy about that!
An update tough about the process of putting things back to normal:
- I cannot delete this specific feed message I reposted (I tried many times, but first it disappears then this message appears and I see the post back to my feed)
- The feeds I am reposting aren't instantly posting to my profile anymore like it was before ... It can take up to a few mins.
Just thought this might help in any way! :)
** to a few mins
** just thought this might help
Man ... such mistakes I am making. Sorry about that!
@cristiana33 fixed :)
@cristiana33 Sorry to hear about your problems with deleting feed posts. Its possible that some tables are corrupted partially due to the outage. Now that we are a bit more stable, I intend to do a full repair to eliminate these type of issues in the coming week! :)
@ezraBC and @KrinkTheMellowUnicorn -
Beginning yesterday, I am no longer able to see any feed posts from the people I follow. The last post I can see that was posted by someone I follow was posted in the early morning hours of Saturday (1ish am eastern) . After that, it stops. Only my own posts are showing now.
I went to the profiles of the people I follow, just to make sure posts had been made and they had. Both reposts and original. I just can't see them.
Wanted to bring this to your attention. :) Please let me know if you need clarification on anything or if you need more information.
I'm exactly the same with @ValentineLove
@ValentineLove
Yep way too quiet for it to be working. I follow quite a few people and nothing in 24 hours besides what I have put.
@ValentineLove Thanks for the feedback. Please let me know if that continues after tonight.
@ezraBC Seems to be working! Thanks so much! This feed addict is so appreciative to those of you behind the scenes that keep it going!
how do you follow a member?
@NuttinHunny Go to their profile and there should be a 'Follow' button you can click on. :)
@valentinelove I did that but no option. I'm on the app. Maybe it's not available on the app.
You cannot follow or see feed post on the app at the time being, you need to be on the site :)
@NuttinHunny If it isn't working on the app, I recommend the mobile browser version. Just open your Web browser and go to 7 cups. I've tested it and the ability to follow works on the browser. :)
@ValentineLove thank you, it's working. It works in the Web browser. ☺
@NuttinHunny
Yes, I'm afraid the app is way overdue for an update and does not yet offer the feed or the growth path (!).
The good news is we are hard at work on updated apps and expect to have them available within the next week or so.
@KrinkTheMellowUnicorn You do not know how much this excites me about the App update
Hi everyone!
I seem to be having feed issues too. I can't see my feeds or that of others and even my followers have disappeared.
Thanks for all your efforts in making the site and app better! :)
Is the feed completely fixed? Some of the hashtags are not appearing for me.
@AffyAvo
No, it is not completely fixed.
Over the weekend, @ezraBC reimported the follower lists and they should be correct. He also fixed some data corruption. But the posts are not complete and hence the hashtag pages are also not complete.
There is still some work to do to fully restore it, and I will update when that has happened.
@KrinkTheMellowUnicorn
Thanks! The announcement didn't provide much detail. Thank you for working to fix things!
@AffyAvo
Yes, sorry for that. The alerts tend to be general since we're trying to inform everyone. It's easier to go into more detail in these forums.
Thank you for asking questions that help me clarify!
Perhaps the alert can be "Followers list for the feed is fixed!" or something about there being progress? @KrinkTheMellowUnicorn
Because I was fine waiting for the feed to be fixed, but the alert only served to set me up for disappointment. "It's fixed!". So I rushed to see my feed, hoping to see all of my posts again, all excited for it... and then, tears upon the realisation that this was not the case. Haha! My face need not be swollen from my cries if not for a more accurate alert. May also help any confusion!
An update for anyone following this thread:
1. It now appears that in the initial #feedpocalypse swarm there was some actual data loss and some people's feed posts from before the bug were in fact lost.
2. At this point we have restored the follower lists and the posts that were not lost.
3. We don't know how many people were affected or lost posts in the initial storm, but it seems to be a fair number of people, unfortunately, including some prolific posters. :(
4. We're really sorry about this and have done what we can to restore missing data. I'm sorry also for reassuring that no original data was lost, as that was our belief at the time, when it turns out that I was in fact mistaken.
what does this mean going forward?
The feed now has sufficient "redundancy" in its storage that we do not expect to see any future data loss, even in the event of another out-of-control feed bug.
There is one more fix we still need to make in the coming days to prevent such future "storms" from happening on the feed.
If you lost some or all of your posts from before the bug-storm again I'm very sorry and wish I had better news for you.
My one consolation is that the feed is healthy and new posts will be safe and we can carry on into the future with a bit more confidence.
Thanks again for your patience and understanding and please accept my apologies for letting anyone down.
@KrinkTheMellowUnicorn Thank you for this update. I'm sure it wasn't easy for you to post this as you had to be the deliverer of bad news.
When it comes to technology, everything is uncertain. And I'm sure you guys did everything you could to try and get it back. One of my accounts was one of the ones that got hit but I'll start over. :)
My recommendation to anyone who takes pride in their feed - keep a tumblr account. (doesn't have to be tumblr, just a place you can save your quotes / images that's not on 7 cups. I don't recommend saving on your computer. Images can take up a lot of space, very fast.) You can keep all of the pictures / quotes on your website incase a feed post is unexpectedly lost. That way you can go back and quickly find the image or quote you lost and you can begin the process or restoration.
If you've lost a precious repost or tag, try checking the original poster's profile. It's a possibility their feed posts were not lost and you can find it once again.
Once again, Krink, thank you and the rest of the team for everything you were able to get back. And props to you for bearing the heavy burden of being the messenger.
@ValentineLove
thanks for understanding
losing data is a cardinal sin in my book and we must do everything we can to prevent that, but I know we are fallible and human and life is not perfect.
i do think things will be more reliable and stable from now on - i also agree with you that services like tumblr are a great way to store content pretty reliably.
@KrinkTheMellowUnicorn
I can't see posts that I could see yesterday. Are these ones lost?
@AffyAvo
no, posts lost from the past day would be a different problem, perhaps the recent restoral overwriting them.
are these posts from your own feed?
cc @ezraBC to consider this case (Ezra: this is not posts gone from before the feed-storm but lost apparently in the past day, perhaps in the latest restoration process?)
@KrinkTheMellowUnicorn
They are older posts, but I could see them yesterday. Both mine and people I follow.
@AffyAvo
ok, i think it's more likely that this may be fixable, since the data was there as recently as yesterday
but i don't want to promise anything without discussing first with @ezraBC...
@KrinkTheMellowUnicorn
Just wondering if you have more info now. Thanks!
Deva to the -station, @KrinkTheMellowUnicorn !!
Great idea, @ValentineLove ! Actually, I saved most of my feed posts in a document. Not something I'd usually do, but perhaps I sensed the upcoming devastation in the air. So, thankfully, I can look back at most things (although still missing quite a bit). But I think I'll perhaps try this Tumblr way of doing things too!
The question now is... Do I want to re-post anything missing? Like my past shout outs to others, etc! It's a shame. Not sure what I'll end up doing. It may be bothersome (for others).
In any case, at least we know this now! So no more waiting.
The grieving process begins.
@QuickJazz
i'd say re-post anything that you'd like to have in your feed for future reference but perhaps not very timely things (like past announcements?) - it's up to you.
again, sorry for this, and I'm glad you made your own (partial) rescue plan in advance.
Yes, that is true. I will think about it!
By the way, one thing I really miss is being able to do (which was, admittedly, only for a very brief time before it left again) was paste something in and the colour formatting would still be there. Is this at all possible to achieve sometime in the future? This would also make it a lot more convenient too if I were to re-post things (as in, restore my stuff). @KrinkTheMellowUnicorn
@QuickJazz
When did the ability to paste and preserve colors change?
We were not able to preserve any of our formatting, until the forum changes happened - the new emoticons and such. When, I believe, this was initially implemented, we were able to preserve all formatting. However, soon after, and - by that - I mean what felt like a matter of days at most, this changed. I am not sure what may have caused the change, as the text sizes are still preserved. However, I remember thinking it may come back (perhaps it was around the time the colours were messing up on the feed?), but it never did @KrinkTheMellowUnicorn
@QuickJazz @KrinkTheMellowUnicorn
For me it's actually the opposite, the size is not saved, but the color formatting stays if I copy paste. but I think that's a browser difference.
On Firefox: saves colors but not the size
On Chrome: Saves the size and boldness but doesn't save colors
I feel like I'm the browser adapter or something ahahah xD most of the time it's different on them cause not everything is supported or it's supported differently, it can be a real maze
the feed seems sick again today. I've been sharing reports with @ezraBC:
- some support network (following/followers) totals don't load
- some support network totals are wrong
- changes made between updates confused (followed someone, getting their posts, but they are not listed, etc.)
- some people unable to repost some posts from some other people
- some feeds showing the "you do not have permission to see this feed error" (seen fron member account)
- some user cards do not show Follow buttons
I don't know if these are all symptoms of the same thing (a dead instance?), but they have all been reported today.
cc @mscoxie, @ace13, @mephobia
@KrinkTheMellowUnicorn The only thing I experienced today is extremely long loading time of followers/following lists and as usual, unable to reposts many posts of the 7Cups' feed and the usual unable to accept follower requests
@KrinkTheMellowUnicorn Maybe this is too late, but I am glad the feed is working right now haha :D