Posts tagged: edFringe

The Elite Squad

The tagline Fearless, the Elite Squad Team and the phrase ‘impossible is nothing’ was all put together one evening at Kraya…

It was an interesting evening and it harked back to a time a few years earlier.

The first project where we had to pull out stops was the pilot project for megabus.com.

The original version of the site was based on an idea and needed to be built from scratch and taken live within a very short timescale. Working on this was exciting, not just because of the adrenalin rush to be working on a project that could change the world (which it did promptly), but also because of the enormous amount of pressure to succeed.

We have since been involved in several such high pressure projects where failure is simply not an option. To date, we have delivered.

My favourite example of this is the work we did last year for the Edinburgh Fringe Festival.

The fringe had a serious issue on their hands about a week into their programme launch in that they were unable to make sales due to problems with their new ticketing system.

On the Thursday (12th June) evening the Fringe called asking if we would be able to build a booking system for them over the weekend. John who answered the call (and initially thought they were kidding) roused the troops.

This started with a meeting on Thursday late evening with the Fringe to identify exactly what needed to be done and the best way to move forward.

We had already been involved on a limited basis in trying to resolve the issues with the booking system. We had also integrated the booking system into the website. This meant that we had a good idea of what was involved.

We had also built the website in such a way that it was fairly straightforward to plug another ticketing system in.

With these things working for us, all we had to do was put together a booking system over the weekend.

In reality, we started work in earnest on Friday morning and the site went live on Tuesday morning. It took four days and about five or six of us. We ran into numerous problems and hurdles, a large number of which were outside of our control including problems with the data.

The edFringe website went live on Tuesday, facilitated online bookings, and we also set up a section within the website for agents to sell tickets over the phone or in person.

All over four days. The last part was the hardest, working about 36 hours straight apart from a wee nap…

Sleeping Shri

Sleeping Shri

There were a few issues that cropped up and had to be resolved over the next few days which was expected considering the timescales involved.

Over the first week or two, the sales had almost caught up to the similar numbers as the previous year. The site was making all the bookings, not just a percentage (as it was the previous year) and it held up with minor issues. Load on the systems did not cause it to fail at any point.

We had completely revamped the infrastructure on which the site was hosted to allow for the kind of traffic that was expected. It was unfortunate that we didn’t really have a chance to take that live properly but it did help to reduce the number of issues the site faced.

The interim system we put into place was since replaced with the original booking system around mid july.

We are responsible for keeping megabus.com running day in and day out and it sees over 100,000 visitors every single day. With this kind of pressure being the basic level of service delivery that we do, there is a certain level of excitement and adrenaline rush that comes from doing something that seems so far out of reach and impossible.

We are currently involved in another project of a much higher caliber that I’ll write about once its completed. Projects like these remind us that we are really are fearless and impossible really is nothing…

Database Systems Compared

My first experiences of a computer started with DBase III+ which is now dBASE, then went on to Foxpro, now Microsoft Visual Foxpro. I have since used Filemaker Pro, Microsoft Access, Microsoft SQL Server, MySQL, PostgreSQL, SQLite and HSQLDB. I have not yet used IBM DB2, Oracle. Wikipedia has a list of database systems.

Having worked with this range of database systems and having done copious amounts of research into DB2, Oracle and other DB systems I have not mentioned, I like answering the age old questions. Which is the best database system?

Ah! if only it was that simple. There is no database system that is appropriate for any given requirement. But then, if you have been in the technology sector long enough, you would already know that. It’s all about using the right tool for the job.

I separate these systems into two broad categories and Oracle. There are the Desktop based database systems:

  • DBase
  • Foxpro
  • SQLite
  • HSQLDB
  • Filemaker Pro
  • Microsoft Access
  • MySQL

DBase, FoxPro, Filemaker Pro and Microsoft Access are essentially a GUI frontend that has a database backing.

Access is the best choice for this purpose under the majority of circumstances. Filemaker Pro is relevant in some. The usual reason to use DBase or FoxPro is simply that the developer is used to it. This is not a good enough reason.

I have used DBase III+ for developing an office management suite back in 1994. I have since used Filemaker Pro to develop a simple contact management database in 1998, Microsoft Access to develop a patient management system for a clinic.

SQLite, HSQLDB and MySQL are database engines that are to be utilised by popping a frontend on top; sometimes the frontend is Microsoft Access. Microsoft Access can also be used for its database engine.

Access is usually the worst choice for this except as a stopgap. There are exceptions to this. One is for a web frontend if the site is not too busy and its running on a microsoft platform. You don’t have to go to the hassle of installing anything on the server. The drivers will take care of it all.

HSQLDB becomes an obvious choice for a light java based application and SQLite for any other lightweight applications.

MySQL is substantially more powerful and scales a lot better. I include it in this section because it is a server grade database system that can also work well in a desktop environment.

I have used Access for several web based systems and I have used HSQLDB for unit testing hibernate and for a quick and dirty MP3 library that linked into musicBrainz. I have used SQLite in passing to be utilised by open source products.

I have used MySQL with an Access frontend as a management suite for a website as well.

And we have the server based database systems:

  • MySQL
  • Microsoft SQL Server
  • IBM DB2
  • PostgreSQL

MySQL was used as the backed database system for the edFringe.com website. This was the perfect choice since the most important requirement was speed. Particuarly with the Query Cache and Master Slave replication, MySQL was the best choice.

SQL Server was used as the backend system for an online course for the Scottish Enterprise around 1999/2000. While MySQL would have been a good choice this, it was not of production quality at the time.

We have also used Ms SQL Server for an insurance company since all the infrastructure was based on Windows and PostgreSQL did not have a viable Windows version at the time.

We use PostgreSQL for megabus. While speed is absolutely critical, it is a ticketing system which means that transactionality is absolutely critical.

While MySQL now has transactionality with innodb, it is still nowhere near as good as the transactionality provided by PostgreSQL through MVCC (Multi-version Concurrency Control). We could have used Ms SQL Server but the cost savings are dramatic.

To summarise, each system has a specific use, specific strengths and weaknesses and which should be used is highly dependent on what it is to be used for. I am hopeful that the summary of what we have used each of these systems for us useful in determining which one is best placed to solve any specific problem 😀

We have not yet used Oracle and it was a strong contender for megabus but the serious heavyweight functionality provided by Oracle comes at a price and it is not yet a cost effective option.

WordPress Themes