Web development encompasses many stages i.e. Planning, Analysis, Web design, Implementation, Promotion and Innovation. Each of these stages requires use of different sets of tools and professionals with varied skill sets.

Planning and Analysis don't require as many software tools as the experience of the web master or project director. They need working knowledge with all aspects of server and database. Familiarity with Operating Systems and the Internet server applications are required. Experience with IP networks, programming languages and database development are also essential. The two most common Operating Systems used are Windows NT/2000 and Unix, although many also use Linux. Most commonly used Internet programming languages include PERL, CGI, ActiveX, ASP, and Java among others.

In the next stage of Web designing, tools such as HTML Meta tags, JavaScript, CGI, Macromedia Flash, Macromedia DreamWeaver and Adobe Photoshop are used. Web templates, graphic designs, photographs, texts, clippings, audio and video are also included, as per the requirements. Flash helps in animation that gives an identity to a website. Visual Basic is the most common language for scripting and SQL with other database engines are used for database management on the website. To create Search Engine Optimized content, tools such as Overture are used. Once the most popularly searched words in your industry are identified and short-listed, the content creators write content using these search words. This ensures that your website lists high in the search engines and directories.

In the Implementation stage, the website is implemented and tested on various browsers. Any functional errors, if found, are corrected. The Promotion and Innovation stages, help in marketing a website. Pay-Per-Click Search Engine Promotion, Loyalty Programs, Email Campaigns and Online Games are some tools used for website promotion. Tools such as site statistics software and reporting from site searches let you know what exactly your visitors are looking for. The content and marketing strategies are then adjusted accordingly. A website also needs to be maintained and continuously evaluated and updated with respect to content, presentation, layout and technical aspects.

Use of good web development tools ensures that your pages have good content, Meta tags, a high link popularity score, appropriate keywords and visual appeal. Although web development tools are essential, it also takes a seasoned team of programmers, graphic designers, content creators, consultants and marketing staff to work in tandem to create a technically sound, visually appealing and highly functional website. A well-planned site, apart from being high in functionality, is also easy to re-design or alter, at a later stage.

Don't be fooled by seeming simplicity. A lot of developers get comfortable with a certain way of designing a database for their web applications that they miss out on techniques they should rather employ to make things run faster and more efficiently. A lot of developers don't bear in mnd that the small site they are creating now might grow into something incredibly large and complex, and the database they designed has become bloated and doesn't scale well to meet the demands of the increased traffic.

This article hopes to provide web developers with a few techniques to help make their database and queries faster and more efficient.

1. Avoid Character Types

When you are designing a database, it is so easy to set all data types to the VARCHAR type as it can then contain any data you want; numbers or text. But character data is amongst the most inefficient data type you can get. If a field is only going to contain numbers, then make it one of the appropriate types (INT, DOUBLE, etc).

Also, wherever possible in your web development code, try to use numeric data types as opposed to characters. One of the most common things a script has to store are flags like whether someone answered yes or no to a question, etc. You could of course store it as 'Y' or 'N' but why not store it as 0 and 1?

The reason this makes a difference is when you have a database, for example, with over 500 000 entries, and are running a SELECT on that field, comparisons are processed a lot faster for numeric data types than character types. Also, if you need to return data to the calling script, numeric data is less memory intensive than character data. In addition, your web development language (PHP, ASP, etc) would also be able to process and perform functions on numeric data better than character data.

I am not trying to convince you never to use character data types. Sometimes it is a necessity, but if you can find ways to reduce the amount of character data processed by your SQL database, the better your server will cope.

2. Normalization

Normalizing a database is really quite a complex process. It is a process that describes a way to design a database structure to avoid repetition of data in your database and can lead to significant performance benefits if employed correctly. However, the entire process of normalisation is a bit beyond the scope of this article as it can fill books on its own, but any developer designing a database should seriously consider becoming knowledgable about normalisation and employing it in their own designs.

For a good tutorial on this process: http://www.keithjbrown.co.uk/vworks/mysql/mysql_p7.php

3. DateTime vs Timestamp fields

This actually relates to 1. a bit. The big difference to bear in mind here is that a field of type DATETIME is actually stored as a series of characters. A field of type TIMESTAMP is actually stored as an integer. So therefore, a more efficient way of storing dates is using the timestamp method. The timestamp has its drawbacks however. For one, you cannot store a date early than 1 January, 1970. Also, timestamps in your script will need recalculating to get to the character format. Because of this recalculation, it may not be better to store as timestamp. It really is a case of testing which format works better for your needs.

4. Use LIMIT where possible

In your queries, if you are doing a SELECT to a database and you only expect a certain number of results, using the LIMIT statement can speed your query up incredibly.

For example, if you have a table of users and you need to run a query to search for one users record, you can use a query like:

SELECT user_name FROM users WHERE user_id = 453;

This query is perfectly valid and will return the right result. But you also know there will only be ONE result. The query above will search the database, find what you want, but then still continue searching after that. It would run a lot faster if you could tell the query that once it has found what you are looking for to stop searching. LIMIT can do this, as this query shows:

SELECT user_name FROM users WHERE user_id = 453 LIMIT 1;

Imagine this scenario. You have a table called logins, that records every login from a user. It currently contains over 2 000 000 records, and you want to find the first time a user logged in. Now bear in mind that because this table inserts data over time, it is already sorted for by date. You could do the following query:

SELECT MIN(login_date) FROM logins WHERE user_id = 4876;

This will return the record you want, but SQL will now have to get all dates for that user, sort them and then return the lowest value to you. Our table is already date sorted simply because of the way it records data for us. So using LIMIT can be more effective:

SELECT login_date FROM logins WHERE user_id = 4876 LIMIT 1;

Because it is sorted, the first one will always be a users first login.

5. Avoid using LIKE

If you have tried to employ 1. above, then hopefully you will be in a scenario where you do not need to use LIKE all that much. LIKE is one of the most inefficient ways of searching a table. LIKE performs a text comparison search in a field and with no wildcards is as efficient as a direct comparison; i.e. WHERE name = 'Jane' is equivalent to WHERE name LIKE 'Jane'. It is when you start introducing the wildcard characters like '%' that things get really hairy.

If you do have to use LIKE, then at least try and make efficient use of the wildcards. These are '_' (underscore) and '%'. Let me explain all this with a real world example.

In a project I was involved in, we had a SQL database storing logs generated automatically from a mail server. Unfortunately, the mail server pretty much just dumped a very long string of text data into a field that contained the data we wanted. A script had to be written to find all logs that referred to a login by a user into the POP server. The only way we could do this was to search every record for a string in the msg field that had the text "User logged in" in it. The first query developed was something like this:

SELECT msg FROM logs WHERE msg LIKE '%User logged in%';

This query took on average of about 35 minutes to process. Obviously not an ideal situation. The way the LIKE worked here was that it had to parse through every single portion of each and every record in the msg field looking for text that matched "User logged in" anywhere in the text. We were able to determine eventually that the text "User logged in" occured at the end of that text in the msg field and so we altered the query:

SELECT msg FROM logs WHERE msg LIKE '%User logged in';

The '%' at the end was removed as we do not want to worry about text after because there is none. The query now only compares text to our string in the msg field at the end of the field and no longer parses through the entire piece of text stored in msg. The query now ran in under 2 minutes. (This was actually still too long, but how we optimised from there is a little beyond the scope of this article.)

Hopefully with all these elements put into practice on your next web development project, you can have a database that runs quickly, efficiently, uses as little resources as possible and wont grind to a halt when the load suddenly increases.

Pay for a web designer or do it yourself? Can small business owners really design a website or is it a job for the pro's?

Most consumers look on the internet before going to a store. Sometimes it is their only stop: they research, compare and buy online. It goes without saying then that for a small business to reach its potential market, it should have an internet presence.

Small business operators do not often have a dedicated IT person on staff - in the past this is the person who would be given the job of building a website. It's great news then that there are now beginner-friendly website building packages on the market which are perfect for the small business person's use.

Data is entered into your web pages as one would using a word processor - with modern easy to use web builders, there is no need to know any html whatsoever.

The tutorials provided with almost all software suppliers take the novice through the process of building a website in a non-technical, easy to understand way. Having completed the tutorial, one is equipped with more than enough knowledge to launch straight into a website build.

Not all website software programs are easy to use. Small business operators do not need fully blown web design industry solutions due to the steep learning curve. One feature to look for is a WYSIWYG (What you see is what you get) editor. This simply means you type on the page as you see it.

There are expenses involved in publishing your own website - you get nothing for nothing. Apart from the cost of the software (there are free web builders however they are more difficult to use or too basic in features), a small business (or an individual or a large company) will need to register a domain name (less than $10) and find a web hosting service (around $8 per month).

Businesses should also set up a merchant's account from an organization like Paypal (free). Having a third party handle financial transactions is always reassuring for consumers and takes away an administration burden. When an item has been ordered via your website and paid for, Paypal advises you, with delivery instructions so that you can fulfill the order or if it is an electronic delivery, this part can be automated.

In any small business time is money, and the time spent learning a new skill like website building with easy to use software must be seen as a good investment. It is possible to build multiple websites so that you can have a website network feeding a central business. This is ideal for multi-brand retailers and multi-branch operators. This degree of control will reap rewards as your business grows and you build different websites to cater to changing needs.

Because you have built and are managing your website yourself, you are able to instantly react to changing trends and new opportunities. Avoid delays by not having to wait for your webmaster to make changes. Fresh content on your website is highly desirable.

Some website programs are specifically designed to assist the business person become an internet business marketer, and as your knowledge of web design grows, the more you will value search engine optimization and site map generation tools. Having a correctly designed site map helps search engines easily match your site to search requests.

If you decide to look at other ways to earn money through your website without doing a thing, you will no doubt look at including on your site some affiliate marketing and advertisements from non compete companies.

Features to look for:

Ideally you will have an instructional video, help desk support and forums. Look for testimonials from other business owners to see how they have applied the software.

Getting started is the next step once you arrive at the conclusion that a website is no longer a luxury - it is essential!