100% CPU on 6000 subscribers
Hello!
We had a forum in the past, based on MyBB, then shut down. I decided to try to convert it into Hubzilla engine. So they can eventually wake up in the Fediverse. I created a plan where accounts are created with fake email, bots are logging in and recreating everything, and in the end emails will be updated directly in the database to the real ones. I created tables in MyBB database to maintain projection.
So I was proceeding step by step mostly fine, but now stumbling on 100% CPU. Last step was to subscribe all 6k users to forum.
Since then, Master.php Queue and Master.php Onepoll create extraordinary load. I fail to identify slow requests. It seems they are just too many. pgAdmin dashboard reports 3k-4k transactions per second, 118k tuples out per second. I enabled opcache for CLI. I disabled SSL for PostgreSQL. I increased pgsql buffers to 1Gb. Nothing helps much. The only relatively effective measure was to set poll interval to 240 seconds. It's still 100% CPU always, but at least jobs are not piling up.
So doesn't Hubzilla able to handle 6k users forum? That's far not the limit I was expecting. Is it an eternal activity or I have a chance to wait untill the end of it?
