ColdFusion Muse

Sick Server Troubleshooting Part 3 - In the Soup

Ok... you've made config changes and tested your connections and performance and you know with the certainty of Rush Limbaugh making a right turn that the server is fully tuned and as lean and mean as possible, but you still have a problem. Now what? Well, it's time to look at the code. Start by enabling slow page logging in the CF admin during a high traffic low performance period. Take the list of templates that are running slow and start digging into them to determine why they are dragging their little cyber feet.

Here are a couple of code related items that you might be looking for.

Heavy Lifting Requests

Coldfusion is so easy and so flexible that Coldfusion developers sometimes develop tunnel vision about it. They start thinking that CF is the best choice for everything - imports, file parsing, FTP batch jobs, batch PDF file generation (ick), automated mass mail, washing dishes, shopping for Mother's day, babysitting, waxing the floors and picking up dog poop in the back yard. The truth is that ColdFusion, like any web application server, is best suited to handle thousands of short requests (i.e. web traffic). It is not terribly great at handling loooong requests that take minutes (and sometimes hours - yes hours) to finish. Now, I have seen tasks that are amazingly complex accomplished in ColdFusion and it can handle the job from a code perspective. But if you really need this sort of functionality then set up a batch server. Don't overload your public server with threads that take up space and have no hope of completing in a reasonable time.

In addition, such requests can often be moved to the database server with amazing results. For example, we had a Coldfusion process that consumed a file of 300,000 records every 5 minutes. By the time the first thread finished it was time for the second one. It was a simply unworkable solution. The same 300k record file using a file driver, DTS and MSSQL task scheduler runs in less than 12 seconds. The lesson is that just because you can do it in ColdFusion doesn't mean you should do it in ColdFusion. Can I just say to all the ColdFusion developers out there - learn to use a cursor for goodness sake!

Conditional Loops

It's silly I know, but every once and a while a conditional loop is not terribly well thought out and causes problems. Conditional loops (or "while" loops if using cfscript) handle some condition or variable this changed as a part of the inner loop code, as in:

<cfset x = 0/>
    <cfloop condition="x LE 10">
            ....
            <cfset x = x + 1/>
            
    </cfloop>
Unlike from/to loops the "while" loop has the potential to be infinite and it has to be written carefully. If the condition is never met, then the loop just keeps looping and looping and looping like a roller coaster designed by a 12 year old boy. If you are hunting for this issue walk through the code and make sure that the variable is guaranteed to reach the condition at some reasonable point. If it is not guaranteed, then add some break code or rewrite the loop to make better sense.

Bad Query Code

In my years I have seen some query code that would make you run and scream. There are 2 types of this sort of thing. First, there is the programmer who doesn't know how to use the database effectively and he does everything in Coldfusion - counting, summing, grouping, laundry etc. A good example is this popular post aptly titled Funny Coding Errors.

While novice programmers can wreak havoc, their errors are usually pretty easy to tease out and fix. The second class of bad query code is much worse. It comes from folks who know a lot about writing queries. I have seen queries that run on for a few hundred lines and includes numerous in line views, subqueries, function calls, and Cartesian joins. Such queries are often attempts to get work done in a single query instead of 3 or 4. That's a laudable goal, but there is a break point where you are not saving or gaining anything doing it this way. Moreover, extremely complicated SQL should probably be wrapped in a stored procedure. If you run into one of these queries and determine that it is the source of your issue, my advice would be to stock up on caffeine laden drinks and sugary snacks and get comfortable. I would also suggest that you do not try to debug a query like this in Coldfusion. Instead, open your favorite query tool for the DB in question (like query analyzer for example). You will get better error information and can examine execution plans and indexing while you are at it.

Class Loader Issues

When using ColdFusion 8 and the 1.6 version of Java you should be aware that dynamic class loading can cause instability in the JVM. In most cases you can move back to 1.5 without incurring any issues. I'm also aware that recent builds by SUN may have resolved this issue. How do you know if you are using dynamic class loading? Well... chances are if that phrase is a mystery to you, you are not using it. If you are using Model-glue or Coldspring these frameworks use injection techniques that might cause this issue to rise up in an abstract way.

Memory Reference Issues

If you make heavy use of CFCs and you happen to stuff them into the application or session scope you might run into this issue with referencing one persistent scoped variable from another. It's complicated, but you can check it out here.

Plea for Additions

For all my muse readers who spend time slogging through performance issues, would you like to add your tip to the list? Either post a comment or send me an email at mkruger@cfwebtools.com. I will add another post with "user provided tips". If you are going to write a novel, please send via email and not the comments. I will post a link back to your blog if I like your tip.

Comments
ike's Gravatar Something CF8 specific... The new CFThread tag opens up some interesting new opportunities for unexpected server sickness... Two things in particular to remember

1) there's a limit (defualt is 8) to the number of simultaneous running threads, and you'll get errors if a request can't get access to an available thread from that pool in a short period of time. So while it may seem like a logical thing to use cfthread to resize images, I know from personal experience that you have to be really careful about how you implement that (because I fouled up a server that way).

2) read the docs real carefully for the section about how it duplicates any values that are passed into the thread arguments - all it takes is stuffing a CFC into a cfthread attribute and viola, memory leak ... it could be nothing, it could just be duplicating that 1 CFC -- or it could be that you duplicate a ton of CFC's that you didn't mean to because it contains a pointer to a factory full of CFCs in your application scope.

Not really part of the tip, but this is something I don't like about the ColdBox object caching utility. It reaps its cache at the beginning of the request, which means the user has to wait for the cache utility to reap and to get around having the user wait, it uses cfthread if it's available (which takes up one of your available threads). A much better solution would have been to use cfflush at the end of the request and then reap after the content had been delivered to the browser, which would work on CF7, deliver content quickly and not use up an extra thread. Unfortunately the ColdBox caching utility isn't written that smartly.
# Posted By ike | 8/13/08 9:02 AM
Handbag's Gravatar Replica Handbags
Our site offers fashion replica Louis Vuitton handbags, Fashion replica Bally hanbags, Fashion Balenciaga handbags, Fashion Chanel handbags, Fashion Chloe handbags, Fashion Christian Dior handbags, Fashion Dolce & Gabbana handbags, Fashion Fendi handbags, Fashion Gucci handbags, Fashion Hermes handbags, Fashion Coach handbags ,Fashion Versace handbags, Fashion Prada handbags, Fashion Yves Saint Laurent handbags, Fashion Marc Jacobs handbags, Fashion Jimmy Choo handbags, Fashion Loewe handbags, Fashion Miu Miu handbags, Fashion Mulberry handbags, Fashion Thomas Wylde handbags.www.good-handbag.com
# Posted By Handbag | 1/23/09 8:00 PM



Blog provided and hosted by CF Webtools. Blog Sofware by Ray Camden.