Staredit Network

Staredit Network -> Staff Lounge -> Something needs to be done now.
Report, edit, etc...Posted by IsolatedPurity on 2005-04-01 at 11:44:01
I was looking up php exploits to try and get a good understanding on the security required for our forms when I came across a exploit for awstats for 6.1 and under. So I decided to check our version (it's safe) but I was looking at bandwidth useage and I'm like omg. We would have been down last month if tyler didn't up ours to 200gigs, I'm gonig to ask him to change it soon. I'm disabling the arcade. Rexy, by herself, used 1.57 gigs last month. Wtfage? Me and you (yoshi) used 1 gig COMBINED (well, me and your normal ip address).
Our 25 "top" users used 65 gigs of bandwidth.

MSNBot uses 750 megs last month while google only used 100 megs. Block msnbot? Lol... why not? No one uses their shitty search anyways... and even if they did, search engines only provide 1% of our current hits (which is REALLY censored.gif ing said I think?).
jpg Image 3763003 35 % 26.30 GB 25.3 %
jpeg images constatuted as 27 gigs...
I wonder why that is? happy.gif
I don't know what kind of compression scheme that scx to bmp program or whatever for screen shots uses, but we need to start compressing images better. Seriously.

MS Internet Explorer No 6717468 62.5 %
Firefox No 1810335 16.8 %

Sad.


WHAT THE censored.gif ?
69.93.72.122 used 30 gigs last month...
It seems to be on a constant incriment. Last vist in march was 11:59 pm and last visit this month was THIS minute.

SERIOUSLY...
Time to talk to tyler.
But we can still fix up things.
Report, edit, etc...Posted by BeeR_KeG on 2005-04-01 at 11:58:29
WTF?
QUOTE
69.93.72.122 used 30 gigs last month...
It seems to be on a constant incriment. Last vist in march was 11:59 pm and last visit this month was THIS minute.


That isn't even a member. I think that the DLDB is just a little bit more than 55GB based on 2000 files on average of 300Kb each. Is he downloading our whole DLDB since thats basicly all he can do.
Check his log activity, he may be stealing our work and psoting it on another site just like icy-hell did in the past.

I'd say put a limit on guests about how much they can download before they have to regsiter. 30 Gigs in one month is way too much.

Rexy used 1.57Gigs? She hasn't been on much these past 2 weeks becasue she was grounded... I really don't know how someone could use so much.

Any chance you could tell me my Bandwith, I'd like to know since I'm supposed to have one of the highest bandwiths since I'm DLDB Keeper and I download a whole lot of files.

Also removing member map might be a good idea. No one really looks at it except for a couple of times. It justs sit there...

BTW: Who is Tyler? Is he like your host or soemthing?
Report, edit, etc...Posted by IsolatedPurity on 2005-04-01 at 12:08:15
Nevermind rexy or the arcade... not important...
I didn't see the 30 gig censored.gif er until after I wrote the post.

You have multiple ips attached to your name, but I can narrow them down to march only and give you last month's approximage stats:
Ip1 = 101 times = 62.51 MB
Ip2 = 58 times = 63.17 MB
Ip3 = 28 times = 31.84 MB
Ip4 = 14 times = 10.68 MB

# of times are recorded by invision and are total amounts

Kinda small I guess, you need to do some more work! happy.gif

Tyler is our host, yes.
Report, edit, etc...Posted by chuiu on 2005-04-01 at 12:14:31
That 30 gig IP goes leads to http://www.theplanet.com/
Report, edit, etc...Posted by BeeR_KeG on 2005-04-01 at 12:19:43
QUOTE(isolatedpurity @ Apr 1 2005, 01:08 PM)
You have multiple ips attached to your name, but I can narrow them down to march only and give you last month's approximage stats:
Ip1 = 101 times = 62.51 MB
Ip2 = 58 times = 63.17 MB
Ip3 = 28 times = 31.84 MB
Ip4 = 14 times = 10.68 MB
[right][snapback]177821[/snapback][/right]


I only started the DLDB about 10 days ago, so it isn't a full month of downlaodng lots of stuff.
About that site that Chu pointed out, what do they want with us really? I don't see why would they spend time downloading stuff from SEN, all they do is sell chips. Or they might be making sure that their stuff complies with programs all over, but I don't see the need for 30GB.

Maybe thats just the IP of that server or something like that.
Report, edit, etc...Posted by IsolatedPurity on 2005-04-01 at 12:20:04
That 30 gig ip is our ip...
lol.

(we aren't hosted on the planet thing though)

alright, back to nuking the arcade
Report, edit, etc...Posted by chuiu on 2005-04-01 at 12:29:34
OMG SEN IS SUCKING UP SEN'S BANDWIDTH.
Report, edit, etc...Posted by BeeR_KeG on 2005-04-01 at 12:37:39
So SEN is downloading stuff from SEN? Thats pretty wierd...

The IP address of my server of my site has only used like a couple of KB from my site last time I checked.

Could those 30GB's be the amount of new space that SEN has taken up during the past month? Could be that it had to be uploaded to the server or something... damn I sounded like an idiot this last paragraph.
Report, edit, etc...Posted by IsolatedPurity on 2005-04-01 at 12:40:16
QUOTE(tyler)
There was a problem last month where a lot of the traffic got logged locally by Apache.  Nothing to worry about smile.gif.  A tiny amount of traffic from that site is normal, certainly shouldn't see a high volume again.
Report, edit, etc...Posted by Yoshi da Sniper on 2005-04-01 at 18:52:10
Damn, we optimized v5 to be faster, but it may not be enough for the moment sad.gif
Report, edit, etc...Posted by IsolatedPurity on 2005-04-04 at 08:29:37
QUOTE
Error: You are too much of an asshole to see this directory
You have reached this Page in error, please destroy your computer because I hate leachers. Get your own server you cheapo

wtf? when did you do that? happy.gif
Mmmm that needs to be changed...

ANYWAYS, our server is hitting the screenshots in conjugation with normal loads. For every page I view (20 screenshots with default catagory browsing x average of... 20-25kb = 400kb), the server hits too... so 400kb * 2 about 1 meg used for EVERY catagory page loaded by a user, in simple browsing mode. This needs to be fixxed or something in the future dldb script. Perhaps no screenshots while browsing along with higher compression.
I'm simply going to rename the screenshots directory for now to something obsure until this is dealt with. I'm not sure if this is something tyler indirectly put into place when he safe guarded the /screenshots directory from sanity like worms or what, but in senv5 hopefully we won't have that problem anyways.
So... dldb screenshots are dead until the script gets fixxed and the images compressed. Could do that now or just have it stay dead until senv5. I'm in no mood to at the moment.

Some screenshots are 80kb, btw. Nice, hey? Sure will be fun compressing all these images. Perhaps split the chore up or something and then make max screenshot... 10kb or so for the future.
Hmph.

Along with this whole thing, the dldb needs to be stricter on acceptance of such files as .wavs. Who is going to attach 8mb sounds to their map? Ugh...
And who the hell keeps uploading AND accepting "broodwar single player campaigns"... I'm pretty sure that's copyright infringement. I deleted them twice already.

PS. I was looking at blizzforums highest referral, you are definitely the conciliatez0r man happy.gif (lack of better word). SENv5 can never come to soon... cleaner, more organized, more impressionable... total pwnage. I want to become better than blizzforums. I want to pwn all... and definitely become the biggest, most popular sc2 site (with the "official map dldb" tag from blizzard!)
Report, edit, etc...Posted by (U)Bolt_Head on 2005-04-04 at 14:45:02
QUOTE(isolatedpurity @ Apr 4 2005, 06:29 AM)
Some screenshots are 80kb, btw.  Nice, hey?  Sure will be fun compressing all these images.  Perhaps split the chore up or something and then make max screenshot... 10kb or so for the future.
Hmph.
[right][snapback]180103[/snapback][/right]


How about allowing two images for each map, A thumbnail and one other. the other be optional and if not used it would be replaced with the thumbnail.

But i guess you would rather not do that smile.gif.
Report, edit, etc...Posted by Mini Moose 2707 on 2005-04-04 at 17:18:13
Heh, I was wondering why the "ratings" column looked like a bunch of Tetris pieces. teehee.gif
Report, edit, etc...Posted by BeeR_KeG on 2005-04-04 at 17:47:25
I accepted those BW campaigns a long time ago but I didn't approve them now or seen them yet.

The Map Generator things makes screenshots depending on map size. 256x256 .jpg for a 256x256 map and you get the picture. Anyone here know how to code it to make it like make smaller images?

Bolt: Having 2 images per map would double screenshot bandwith in the DLDB.

Moose: WTF?
Report, edit, etc...Posted by Yoshi da Sniper on 2005-04-04 at 18:13:55
QUOTE
So... dldb screenshots are dead until the script gets fixxed and the images compressed. Could do that now or just have it stay dead until senv5. I'm in no mood to at the moment.
I think thats overkill. Now no one can submit screenshots, and we're still about minimum a month or more away from actually getting the basis for the entire site working. Upon upgrading, the DLDB keepers will be swamped with having to upload screenshots for possibily 200 maps or so. I do not want to do that. Instead, we should disable screenshot viewing for normal cateogry view, and have them view when within file view. It will not take nearly as much bandwidth because people do not look at individual files as much as they look at categories.


QUOTE
ANYWAYS, our server is hitting the screenshots in conjugation with normal loads. For every page I view (20 screenshots with default catagory browsing x average of... 20-25kb = 400kb), the server hits too... so 400kb * 2 about 1 meg used for EVERY catagory page loaded by a user, in simple browsing mode. This needs to be fixxed or something in the future dldb script. Perhaps no screenshots while browsing along with higher compression.
This I don't get. How the heck does the server have to do with anything to do with loading images?



Definately planned for v5: Map screenshots will be JPGs (maybe PNGs too, if I can convert them to JPG upon upload) and will be AUTOMATICALLY compressed when you upload them, should bring the size of all these screenshots down automatically. Its better for the server, better for the DLDB keepers, better for everybody.
Report, edit, etc...Posted by Mini Moose 2707 on 2005-04-04 at 18:17:31
You've never played Tetris, Beer?
Report, edit, etc...Posted by BeeR_KeG on 2005-04-04 at 18:22:15
Oh, I didn't realize that removing the screenshots would make that area smaller and line break those bars.
Report, edit, etc...Posted by Yoshi da Sniper on 2005-04-04 at 18:22:56
I'm going to take out those stupid bars, and just have it a numeric number in v5...
Report, edit, etc...Posted by IsolatedPurity on 2005-04-04 at 19:49:29
Thumbnails can automatically be made...
.png's are a shit load higher quality than .jpgs, so, bad idea...
Overkill? No...
Screenshots should be able to be uploaded still.

One thing I would like senv5 to have is better melee images... It can have a simple thumbnail and then on the dldb screen, be able to load a highly compressed map layout thingy... I dunno, the type of screenshot taken that shows you the whole map in detail.



Report, edit, etc...Posted by Yoshi da Sniper on 2005-04-04 at 23:39:25
Its possible to do that for every map, however, once again someone will have to go back and upload the bigger versions of all these. Plus proedit protected maps wont generate these images.

The way I see it right now, you removed screenshots, and no one knows why except they presume its broken or we're not accepting screenshots because you're not telling them?
Report, edit, etc...Posted by IsolatedPurity on 2005-04-05 at 09:58:36
Every map isn't important, just melee maps.
Would melee maps be protected? If so, could just contact them if they wanted to add a detailed picture of the terrain.

People are still uploading screenshots.
Shall I make a post about it?

Report, edit, etc...Posted by Yoshi da Sniper on 2005-04-05 at 11:29:39
Remember, sometimes its not the creator submitting. We could just have it say 'no picture avaliable' until I learn more about the chk format to make my own pic, or you can use map generator and resize in photoshop. Its more of a pain, but yeah...



Anyways, I don't see how people can still submit screenshots... just remove them from normal category view and have them show up in file view. I really dont see why that'll kill our bandwidth.

BTW, did tyler respond?
Report, edit, etc...Posted by IsolatedPurity on 2005-04-05 at 11:48:27
Alright, are you sure this isn't a problem? It's still using massive gigs and upon looking at it in the latest visitor's log, it's accessing like 30 different screenshots in the last minute. I'm just thinking about how you said the screenshots thing was used to overload the server earlier.


There may be something with the screenshot script that is causing hits to the shots to show up from the local IP. Never seen this happen before, the server is certainly not randomly viewing your screenshots.

Oh, wait. That cronjob... could it have something to do with it? Hits from the cron daemon would show up as the local IP.


Nothing to do with cron...
I took the board down for some isolated testing, and it seems for every picture I view from the screenshots directory, the server hits it too. I'm not sure the reason for this, as it wasn't happening two months or so ago, but I'm taking the directory out of the picture for now. The load on it is way too high even without the double hits (20 pictures per page with no compression at all = excessive waste).


Thanks for the update. If you believe this is being caused by something on our end, let me know and I'll check out any leads you have.



Viewing the screenshots in the file view probably wouldn't kill our bandwidth, but none the less, it's still unnecssary waste until the problem is dealt with.
Report, edit, etc...Posted by (U)Bolt_Head on 2005-04-05 at 12:23:23
QUOTE(BeeR_KeG @ Apr 4 2005, 03:47 PM)
Bolt: Having 2 images per map would double screenshot bandwith in the DLDB.
[right][snapback]180338[/snapback][/right]


No, thats not what i mean. You would have a small ass thumbnail image that is veiwed in the main catagory veiw and a larger version to be viewed when you look at the file and/or click on the image. Basic Image Gallary.
Its differant than using one big image and displaying it small.


QUOTE(isolatedpurity @ Apr 4 2005, 05:49 PM)
One thing I would like senv5 to have is better melee images...  It can have a simple thumbnail and then on the dldb screen, be able to load a highly compressed map layout thingy...  I dunno, the type of screenshot taken that shows you the whole map in detail.
[right][snapback]180469[/snapback][/right]


QUOTE(isolatedpurity @ Apr 5 2005, 09:48 AM)
Alright, are you sure this isn't a problem? It's still using massive gigs and upon looking at it in the latest visitor's log, it's accessing like 30 different screenshots in the last minute. I'm just thinking about how you said the screenshots thing was used to overload the server earlier.
[right][snapback]180821[/snapback][/right]


I know, its google image search. lol just kidding.
Report, edit, etc...Posted by IsolatedPurity on 2005-04-05 at 12:31:03
Having two pictures has the *potential* of more load. Even if the bigger images are only resized to be small, it's still cached so when the person clicks on the file, it reloads it from their harddrive (hopefully). So there's a line on how effective that would be... Besides, having thumbnails is just an increase of a mess and space, but still a possibility I guess.

Mmmmm I'm thinking I'm going to only allow msn to view the index page or something. <meta name="msnbot" whatever="nofollow"> or however that command goes. 1 gig of space for a spider is way too much in my books, especially for a shitty one.

Bring on v5... The sexiness is overwhelming.
Next Page (1)