Browsed by
Category: Miscellaneous

Battle of the Evil Server Goblin… There can Only be ONE!

Battle of the Evil Server Goblin… There can Only be ONE!

I refuse to concede defeat against the evil server goblin that has been stalking me around cyberspace, using my server as a cudgel aimed directly at my un-offending (keep the guffaws to a minimum) skull. That green little bastard is GOING DOWN!

What green server goblin you ask? THIS ONE:

Server Goblin

What’s that you say? It’s merely a Photoshopped (Photopainted actually) photo of my daughter’s latest McD’s Happy Meal toy? NONSENSE! What you are looking at is a 100% pure mean green server piss off machine, and it’s out to get me.

All I have to say is thank God for my brother-in-law Elvio (owner of coolcommands.com and probably one of the smartest, no-nonsense grep-heads you could ever meet), and for the quick turn around times from the P2L coding talents of Nick and Jamie.

Here’s the latest scoop on what’s been happening… I left Server Seed awhile back due to another disappearing act and I have been through a rather spectacular list of service providers looking for someone to simply give me what Server Seed had in terms of performance, but with some degree to available support when things go wrong. Well up until recently, it seems like I just can’t get those two together in a single package unless I want to bend over and let Media Temple be my daddy. (MT has great shared hosting prices, but their true dedicated hardware pricing is nothing short of laughable). My latest setup is a box I purchases directly with Softlayer and I bought some management from a third-party provider.

Since then, I am getting great service, but loads on the box are VERY high compared to what I’m used to and performance, in my opinion, sucks. So I’ve been chasing this new management company about it and I’m basically getting nowhere. In a recent request, I asked that SSL be disabled along with imap and some other ports/services I didn’t need and were open for nothing. I won’t get too deep into the response, but I was told that Apache would have to be recompiled in order to shut off SSL. Ummm… no.

So, I asked Elvio, master of all things Unix, to snoop around on my box and check out the settings and see what’s what… I think it was the whole Apache recompile thing to shut off SSL that had him seriously worried about what my server looked like from the inside. Well needless to say, it was a dog’s breakfast, so my tutelage in Unix command prompt began. He basically had to rebuild the config, recompiled Apache and upgraded it to version 2 (yeah, Linux 1.3 on a multicore, multiprocessor box… that wasn’t a great idea) and upgrade PHP, plus clean out a bunch of other crap. That was finally done tonight actually.

Next up was to basically study the server’s performance and resource usage… and to accomplish this, he installed an AWESOME package called Cacti. This is a freeware based network graphing solution with a sweet user interface that even I can figure out in under 5 seconds. Check it out at www.cacti.net

cacti

By studying cacti’s reports and staring at the regular top processes and MySQL top processes, we started to identify coding related areas that could be improved to run more efficiently. Once again Elvio made some suggestions based on his analysis on the logs and Nick and Jamie went right to work kicking CPU ass! In fact, load was shaved right down by improving the caching system, combining includes into single files and tonight, Nick re-worked the Boolean search query as per Elvio’s search method and has cut down search times BIG TIME! For those of you with fast connection’s, you may remember the average search time for a tutorial was about 5 seconds or longer you were searching during a peak time. Well I’ve been search this evening with the box on an average load at results were coming back pretty much instantly!

So, things are definitely improving in terms of server performance and we hope people are enjoying the site as we look to speed things up and get the server back to being reliable and stable. That damn green goblin is GOING DOWN!

In summary, here’s what I’ve learned lately:

– Be wary of server management companies… they seem to go to pieces when things go beyond simply restart Apache.
– You don’t have to recompile Apache to disable SSL (Actually I knew this… I just can’t believe that’s what my management company tried to tell me)
– Disabling imap doesn’t affect POP (See previous note about management company)
– You don’t have to run DNS Server services to run your email properly (See previous note again)
– Top and MyTop are your friends
– Nagios is for monitoring, Cacti is for reporting (both rock)
– Multithreading is a feature added to Linux in version 2+
– Natural Boolean results already return results sorted with correct scoring… if you get query results back with 0 scores, your query is screwed. You should not have to re-sort them for correct score values. (Hey, I’m not a programmer, how the hell would I know?!)
– Elvio, Nick and Jamie are EXTREMELY patient… to the point of impossibility even.

That’s it for now guys! 1AM and I’m tired. Battling green server goblins is tough work… gnite!

Dan

Looking for Tutorial Publishers and better wait times on P2L!

Looking for Tutorial Publishers and better wait times on P2L!

Hi all,

Just wanted to share a post I just added to the P2L news area just in case any misses it:

No, we’re not looking for 3 day line-ups! What I mean to say is that I’m happy to report that with some hard work, we’ve managed to maintain a 2 to 4 day queue for tutorial approvals for about the last week and a half! I wanted to improve the time you have to wait to get your submissions looked at, so every day I have been approving tutorials for a couple of hours until I got caught up, and as of lately, by the end of the day only the last 2 days worth of submissions are waiting for approval. So I hope everyone enjoys the speedier service 🙂

Now for the publishing bit… do you like to write tutorials? P2L is looking for some folks that would be interested in beta testing the publishing/writing side of our new Publishing System. A few weeks ago we re-released the old Twodded tutorials to show you how published tutorials would look, and very soon we’re going to open up the publishing area itself to all our members. But, before we go live, we want some folks to get a taste of the new system and publish some tutorials that will test out all the kick ass functions we’ve built into this system.

So if you would like to be among the first group of publishers to beta test the writing portion of the new Publishing System, please send me a PM (Click here to send me a PM) and let me know that you are interested and what category(ies) you would like to write in. Applicants will have be prepared to do the following:

1. Write at least 1 tutorial within 1 week of being granted access to the system
2. Write the tutorial using the tools provided by the system. No copy/pasting from older tutorials and no hotlinking/public hosting etc.
3. Report any bugs
4. Use as many features as possible to test the system to the best of their ability
5. Provide screenshots and error message details to the programmers

Applicants with the following qualifications will have [b]priority consideration[/b] in being selected for beta testing:

1.You were previously a member of the P2L Twodded staff
2. You can provide samples of previous tutorials you have written

Please note, you must be a member of P2L to apply. Also, please don’t be alarmed if you apply and I do not answer you right away. I will keep a list of applicants and contact the invitees when we’re ready to test.

That’s about it for now guys, so remember to PM me if you’re interested in trying out the Publishing System!

Thanks,
Dan


Can’t wait to release this system to the public… Nick is doing a KICK ASS job on this!

Dan

Another Day, Another Server Change!

Another Day, Another Server Change!

Hi all,

I’ve been spending my morning tabbing between P2L and my other sites checking out how the server updates are going and I thought I’d take a second to give you guys an update on what’s happening. I decided to leave already Server4sale for a couple of reasons:

1. I just feel overall they weren’t able to deal with the constant issue of Apache locking up. Basically the server wouldn’t load any sites until someone restarted the Apache service, and this lock up would happen at least every 48 hours, although sometimes it would happen every 6 hours. This has been an issue since pretty much the first day I signed up, and a month later it was still happening. S4S tech support is lightning quick and they would quickly reset the service very quickly, but the fact that the server was so unstable and didn’t seem to be getting any better bugged the crap out of me.

2. The server underwent a couple of minor ddos attacks apparently and I didn’t like the way it was dealt with at all, plus the LayeredTech datacenter has no ddos protection on it’s network at all unless I pay additional fees for hardware protection. When I was with ThePlanet, their network had some basic protection as well as some hardware in case the ddos was significant. So I feel that between the DC and the host, they just couldn’t deal with it effectively and I was basically hanging out to dry.

I started looking around this week for a new datacenter and finally settled on SoftLayer, which has several ddos mitigation tools if required. I bought the box directly from the DC so there is no middleman, and I ended up with the same box I have now with double the RAM and a bit cheaper. Nick was able to transfer all the accounts for us and I went with a company that specializes in server management called Platinum Server Management, which monitor and maintain the server for me. So far they’ve done all the optimization and OS hardening and the server is running great! None of the initial issues I had seem to be cropping up this time around, so already that’s a great sign.

Now I just have to wait until the DNS changes kick in around the globe and see how the box runs under a full load.

That’s the deal with the servers… sorry for all the jumping around guys, I’m just trying to find a stable and solid solution I can stick with.

Dan

Pixel2life Presents the Publishing System – Phase I

Pixel2life Presents the Publishing System – Phase I

In case you missed the announcement, Pixel2Life.com recently re-launched the high quality tutorials that were once published under the now defunct twodded system as the first look at our new Publishing System. We still have a lot of work to do on this, but we wanted to give folks their first look at how the published tutorials will look plus we wanted to get the tutorials back online because so many of our users were requesting them.

Pixel2Life.com Publishing System

The actual category browsing system for the tutorials is not yet functional, so the best way to see a full list of published tutorials is via the source site page at http://www.pixel2life.com/sourcesite/pixel2life_com_publish/. Included in this list is Tiago Dias’s famous Flash XML MP3 player and all the other popular tutorials that you guys were spamming me to put back online.

So what’s next? We’re now working on the actual Publishing System itself where our members will be able to write their own tutorials with full image and media hosting combined in a very sophisticated writing environment. I’ve seen bits and pieces of the interface Nick has been working on and it’s nothing short of amazing, so I’m sure you guys won’t be disappointed. We’re also going to have featured writers, ways of making some money from your tutorials and monthly prizes for top writers and contributors. We’re VERY excited about this product and I can’t wait to see what you all think of it. Stay tuned for more updates as we get closer to launch!

Take care!
Dan

General Update – Servers, Sites and Other Goodies

General Update – Servers, Sites and Other Goodies

Good morning everyone!

It’s been a little bit since I’ve been able to post here on my blog so I thought I’d better get on here and post myself an update. In business news, I’ve been having a bit of a time getting the new server going now I have moved away from Server Seed and I am no longer at ThePlanet data center. Instead I have moved to LayereTech with a managed solution form Server4sale.com. Here’s a post I left in the news at P2L that describes what’s been happening:

It’s no secret that it’s been a bumpy week and a bit with the server, and I thought I’d take a few minutes to let you know what’s been going on, where we’re at and what’s getting done.

First off, we are no longer with Server Seed hosting… we have moved to a managed solution with Server4Sale, which has the best, most incredible customer service I have ever seen! So with that said, I just want to point out that P2L was hosted with Server Seed from day 1, thus Ty has had the advantage of being with us as we grew in size and was able to adjust our various servers as required. We started off with shared hosting, then eventually went to a dual Xeon, then 2 dual Xeon boxes, then to a dual core dual Opteron. We had many issues over the last couple of years and Ty was able to fix each one as they came up.

Well now we’ve changed hosts and they simply had this huge site dropped in their lap and have had no chance to build up the box with us. So all the issues and errors Ty had with a bare bones install over the last couple of years were basically thrown at our new host all in one shot. This ranges in stuff from special MySQL config adjustments, Swap tweaks, to firewall filters and tweaks for mitigating the more or less constant ddos attacks we get. MOST of these adjustments have been done without a hitch, but right now we suffer from 2 main issues:

1. The firewall is banning legitimate traffic.
2. RAM suddenly climbs to 90% usage and the sites are unreachable for 15 minutes or so every 6 hours or so.

For issue 1, we are continuing to tweak the firewall and mods so they do not ban legit traffic, but people under common IP masks are an issue. We are working to overcome this problem and so far we’ve only had 1 person get banned in the last 24 hours that I know of.

If you get banned:

You might be IP banned if you are unable to get to P2L or any other site on this box (like my blog) and you get a 403 error in your browser. If you get a 404 error, a DNS error or a timeout, this is not a ban issue. Another indication that you could be banned is to try and access the site using a Proxy. I welcome members to post their favorite proxy sites in this thread if they wish. If the site comes up in a proxy, you’re either IP banned or there is a routing error. If you suspect you are banned, I need you to do the following:

1. Open a dos window. (You do this by clicking on Start > Run and typing “cmd” or “command” in the window and click OK. This will open a black dos box.
2. Type “ping www.pixel2life.com” and hit enter. It will run 4 ping attempts. Once the 4 pings are done, take a screenshot and save it.
3. Type “tracert www.pixel2life.com” and hit enter. This will run a trace route and will show you all the hops your connection takes to get to P2L. It will hope anywhere from 10 – 20 times normally until it reaches the server. Once it’s finished, take a screenshot of that.
4. Send an email to me at info at pixel2life dot com and attach your 2 screenshots along with the approx date and time of your ban and the name of your ISP if you know it.

With this information, I have a better chance of checking to see if you are banned and working on a solution to ensure you are not banned again. At this point the chance is fairly remote that it will happen… there has to be a big chunk of data coming from you.

Now for the memory Swap issue… We actually had this same RAM spike issue on Server Seed when we launched P2L v3 and Ty had to change something on our config to fix it. Unfortunately with Ty MIA, I have absolutely no idea what it was, so our new host is trying a few things tonight to try and fix it. In the meantime, if you suddenly are getting a timeout on P2L, it’s probably that memory issue so just hang tight for a few minutes while we fix it.

I am aggressively working on all the server issues and I am working with the host on a daily (hell… HOURLY) basis trying to get everything working smoothly. Right now we are working on trying to get this server to do what we need, otherwise we will look at some other options or possible hardware upgrades on this one. Either way, I’m doing what I can and I thank everyone for their patience during this adjustment period. I know it’s a pain in the ass for many of you… heck I went through 2 days of the site taking 5 minutes to load the main page. I was ready to toss the monitor out by office window. Donna has been banned by the firewall pretty much daily.

So that’s the deal for now guys… as always, please report and errors you see and if the site is totally unreachable, please be sure to send me the ping and tracert screenshots… those are vital in helping me out with all this. It’s tedious for you, but it helps everyone in the long run.

Thanks again everyone for all your help!



The real pain in the ass with this has been the banning of legitimate traffic, so as of right now, I’ve disabled mod_evasive to see what happens. So far the APF firewall seems to be doing it’s job and the site appears to be running fine.

In other news, I also posted a warning to webmasters that buy tutorials from authors for their sites. If you’re not sure what I mean, many webmasters that run tutorial sites don’t write the actual tutorials… they buy them for $10 – $50 each from someone who writes them and then they publish them on their sites with full rights to the content. The problem is that some publishers out there are selling tutorials that were copied from other sites and are getting scammed. So if you’re someone who buys tutorials, check out my little post on the subject.

I would also like to share an amazing video I found on the Dove website. It’s probably one of the most revealing videos I have ever seen on how the Hollywood industry can turn anyone from the average person to a super model. It’s a real eye opener to people that bust their butts trying to look like a cover model. Check out the video here. Bottom line, you won’t look like a cover girl unless you can physically apply photoshop edits to yourself.

Google has also just announced their amazing new Custom Search Engine technology, which looks very cool. You can get more info and a full review from Matt Cutts.

That’s about it for now… I have some other things I want to talk about P2L related, but I’ll add this in another post 🙂

Enjoy!
Dan