Just the start, but here they are:
We’ve decided to go with the 2d ones.
Archive for March, 2006
The last version of Stuffed Tracker was released in the beginning of January 2006. So it’s been 2 months without new versions which is unusual for us (we try to release a new version every month).
But there is nothing to worry about. Ivan, the main developer of Stuffed Tracker, had to take some time off to help with implementing the new interface for Factory Nova and also do some custom development work for our friends from Florida.
He is now back to work on the next version of Stuffed Tracker, but we still don’t expect it to be released at least for another month. I’ll explain why.
The time has come for us to focus on Stuffed Tracker’s perfomance. Don’t get me wrong, even before we’ve released the initial 2.0 version we’ve optimized the speed of the code and the database to the maximum. But as it appears this is still not enough.
Working with statistical data (collecting & analyzing) is one of the hardest tasks in web software development and only because the amounts of data could get huge when popular sites are tracked or you are tracking tens of thousands of keywords on Google (or more). With such volumes you can easily get millions of records in the stats database in just several days and much much more after a month or two of tracking.
Really, everyone has the same problem here. I am still waiting for my invitation to Google Analytics although I signed up for it a week or two after Google launched the service.
So, again, making the database to query a set of data which contains tens of millions of records in real time will be a challenge even if you are doing this on a dedicated server with 2 Xeon processors and 4 Gb of memory.
How can we solve the problem, we were thinking. And eventually we’ve come up with several ideas that we think should work:
1. No real time reports (as an option) — the reports will be prepared by a cron script and a user will view an already prepared report which will load fast and the loading time would not depend on the amount of statistics that you have in the database. This feature is especially challenging because of the dynamic nature of our reports constructor, but we think we know how to solve this.
2. Delayed tracking (as an option) — tracking will get rid of all of its current logic (which currently does mutliple requests in the database, thus increasing its load), it will brainlessly log every tracking request somewhere and then a cron script will process this log and will put the data in the proper database tables, apply required logic, etc.
3. Archiving of the old statistics — we are planning to make it possible to archive the old statistics in some form so that you will be able to view the archives later and delete the data that was already archived to free up the database and increase the overall performance of Stuffed Tracker. It would probably be possible to optionally do this via a shell PHP script (especially important when working with huge databases where a normal PHP script accessed through the web could timeout).
4. AJAX in the reports — to make the reports more responsive, convenient and generally to ease the pain of waiting for the slow reports in case we will still have them somewhere.
As you can probably imagine, these ideas are not fast to implement, but we are confident we need to do them before we will move forward with any other features. This will be a strong foundation for Stuffed Tracker on top of which we will be adding new features and functionality in the future.
Starting from this January we are undergoing some changes. We’ve just moved to a twice bigger office, but that’s not all.
Shal
Unfortunately, Shal Jacobs, the main developer of our project management software Factory Nova, has decided to pursue his own project and has left Stuffed Guys around Christmas. He was planning to do this for several months, so it didn’t come as a surprise. But certainly this influenced the schedule of the beta version of Factory Nova.
For 2 months I was working on finishing Factory Nova myself. That was an interesting experience for me. I worked some insane hours every day (I think it was around 18 hours every business day, plus a little less on weekends). After I was returning home in the evening, a new working day was starting for me.
New PHP developer
That wasn’t that bad (except the absense of free time), I had some great time programming interesting stuff, I’ve managed to achieve some good progress with the software. But then we were lucky enough to get a new experienced PHP developer on board and now the future of Factory Nova is in good hands (we are really close to finishing beta.. no, really!).
The new developer had to spend several weeks on learning how things already work in FN, but now he is working on the list of the remaining bugs and features at full speed. The new interface is also almost implemented, our designer started working on the fancy icons and I hope that soon I will be able to show some fresh new screenshots.
Slava
In January, we’ve also got one more developer on board. I want to introduce Slava Snakin who is now working on the hotels reservations system which we’ve developed and are now maintaining for our friends in Skoosh International.
+2
We also plan to hire 2 more developers in the next 2 months. One for our Perl-based projects and another for our PHP-based projects. If you happen to live in Moscow, read this blog, have a good great knowledge of Perl or PHP (or better both!) and might be interested in working with us, please feel free to contact us.
The new PHP developer will help us to work on our products and improve the speed with which we release the new versions (this will become especially important with the release of Factory Nova, when we expect our load at least to double).
Coming up next: what’s up with Stuffed Tracker.
After more then a year of enjoying our work in a tiny 20 square meters office, we’ve just moved to a 2 times bigger office in the same building. We are going to hire at least 2 more developers in the next 2 months and we need additional space for them.
Here are some photos of the new room:
