Printable Version of Topic

Click here to view this topic in its original format

-=Reborn JEDI=- Forums _ The Jedi Information Superhighway _ Server Logs

Posted by: Equanimity Jan 11 2004, 07:49 PM

Ok, what I'm proposing here, I assume, is VERY HARD to implement. So don't scream at me if what I'm asking is outlandish.

Is there any way to add a feature to our website which actively ports all the activity from the server logs and places it onto a constantly updated Java (or some other mechanism) field which we can monitor from the RJ only section?

Also, is there any way to discover someone's IP address? Is it possible to log these as well?

These are hypothetical questions coming from an idiot who knows nothing about websites, so please forgive me if I'm saying something inane. smile.gif

Posted by: JayBaen Jan 11 2004, 08:13 PM

Very timely that you should ask that ...

Deacon and I are working on that very thing. There are a few different "logparsers" that are already available and can generate items such as Clan Stats from our exisiting logs. They aren't quite sophisticated enough to do the admin tools for which we'd like to use them (like IP tracking for instance) ... but that information IS in the logs, it's just an issue of pulling it out.

We are trying to bend and existing statistics parser to do just that. We'll keep you posted on how the progress goes.


Posted by: Deacon Jan 12 2004, 11:24 AM

Jay, I have some more info regarding the logs and such. As you know, voodoo stats is dead. Psycostats is not at q3 yet. There is a new stats app called nstats. This is new, but it looks interesting.

unsure.gif unsure.gif unsure.gif unsure.gif unsure.gif unsure.gif unsure.gif
We should discuss this before proceeding as the app costs $$. Also, the developers are willing to put in anything we want (within reason). They were very interested in working with up since they need jo and ja log files to test with.

IM me at some point so that we may discuss these options.


Posted by: Equanimity Jan 12 2004, 03:25 PM

How much does it cost?

Posted by: Deacon Jan 12 2004, 05:11 PM

1 Million Dollars.... Muhahaha MuHAhaha MuHAHAhaHA!

Actually, it costs $35 per server running (non-commercial use) I'm going to get it for my DoD server and see how well it works.

Here are out options as they stand:


Posted by: JayBaen Jan 12 2004, 05:45 PM

I wouldn't be opposed to any of the options ... here's 2 more cents:

In the ultimate scenario, it would be great to write our own. We may be able to beg and borrow from some existing scripts, adding what we need and complie using Visual Basic. We'll see how deep the rabbit hole goes ...

If that becomes more work than we'd like, I wouldn't mind the nstats option, as we'd get to be in on the creation from the ground up.

Finally, PsychoStats is becoming an online gamining community standard. Many hosting companies (including our own XGS) already support the use of PsychoStats. If we can "skin" a flavor of that to match JK, (which I know ChosenOne has already inquired about), that would be a grand option, too.

Deacon ... we'll chat.


Posted by: Deacon Jan 12 2004, 07:43 PM

But what, THERE'S MORE.

The folks at nstat are from "Down Under." They tell me that many GSP are buying their software. This means that along with pstats, the folks who host RJ's server might also support this app. That being said, the advantage of nstat is that it is live. Stats are sent to your remote (or local) server in realtime. They intend to support modules or pluggin that will make it easier to support mods like JediMod or AdminMod.

I'll keep everyone posted.

Jay, let's use teamspeak or AOL as the nstats folks flood my messenger every single time I log on. sad.gif



Posted by: Equanimity Jan 12 2004, 11:45 PM

How hard are these things to code? I gather that it's quite a task, though I don't know which of us has the skillsets necessary to pull it off. Of course, if we COULD code it ourselves, that would be a rather awesome feat.

Posted by: JayBaen Jan 13 2004, 06:30 AM

Unfortunately, it's a little harder than it looks (for those of us still fledling Visual Basic folks), and besides -- why re-invent the wheel if we dont need to.

Deacon, one of the other had a "real-time" option as well ... was it Voodoostats? (talk about a script that would need reworking -- as if that's possible with that app).

BTW, do you find it encouraging that the nStats people are hounding you already ? happy.gif

I apologize for not getting with any of you "live" the last couple of days, the new business is keeping me a bit busier than planned this week. Glad we've got the forums to catch up.

Deacon, I'll make time later today (Tues) if you've got some.


Posted by: Equanimity Jan 13 2004, 11:22 AM

Re-inventing the wheel is definitely positive if existing wheels are square. wink.gif

Plus, re-inventing the wheel is cheaper...(well, in our case).

Anyhow, I understand the difficulty involved, and, despite my aforementioned opinions, support "procuring" (wink.gif) a commercial version.

Posted by: TheBeast Jan 14 2004, 10:48 AM

I talked to Deaon yesterday on the server... and I just wanted to offer my help if you need something to be done in PHP... but like I said... I can make it work... but it won't be pretty smile.gif

So we would need Liz and his skillful hand at web design to make this thing work AND pretty biggrin.gif

- Beast

Posted by: JayBaen Jan 14 2004, 02:13 PM

Thx Beast ...

The initial step is still going to be actually parsing the data out of the logs (the stuff we want), into either an array, another text file, or a database (mySQL probably).


The php web front end comes in.

I'll let you know.


Posted by: Equanimity Jan 14 2004, 08:26 PM

***Totally unrelated to thread***

You know what would be really awesome??? If we could have this program capture what people say on the server (real-time) also, cause then we could have conversations with people who are talking from outside the server while on the inside.

Is this feasible?

Posted by: TheBeast Jan 14 2004, 10:52 PM

Jay: I know... that there is a lot to do before the PHP front end... I just thought I could lend a hand if needed... so don't be afraid to contat me if the need

EQ: I remember that we already thought about doing something like that (matching the rcon command with a 'real-time' log parser)... but I think it was branded as too difficult... of not feasible... but because we are working on a log parser... maybe we can make it do

I think it's worth looking into again

- Beast

Posted by: Equanimity Jan 15 2004, 02:37 AM

Just out of morbid long does it take to create and set up something of this magnitude? I'm sorta curious as to how large a project this is turning out to be.

Posted by: JayBaen Jan 15 2004, 02:58 PM

Longer than it seems like the day ever allows .. sad.gif

BTW, we are finding some scripts that take logs nearly 'realtime' and push their info into a pre-parser, then into html code. Some of them may work for our needs, some may not. We're trying to hybrid something so that it will do EXACTLY what we want.

One of the pre-fab ones that does most of what we'd like is

Just a sneak peak at what Deacon and I are spending our time wading through. This data has been collected from some brand new logs (this entire past week) and a couple of old logs.

Notice who's still 'king' of the forest ...


Posted by: Equanimity Jan 15 2004, 06:39 PM

Some of those stats I have trouble believing...I mean...the last time I saw Butter-Bean was like 5 months ago, yet for some reason, he's still listed there. Unless there is a way to limit the statistics used in calculation to the time span of say...1 month, or 1 week, then some of these stats could get really weird. What do you guys think?

The interface isn't bad at all though. smile.gif

Posted by: JayBaen Jan 15 2004, 07:41 PM


The stats are from various (and a rather sporadic collection of) server logs -- a few very new .. and a few old. If we were to use this, I would start the stats over "fresh," this data is for testing only.

The way this particular parser comes to it's calculations is not simply by frags, but rather ratios of frags to deaths, etc. (check the FAQ on the stats site for the details).

Yes, this can be truncated to only keep track of a certain time period of stats, either by limiting the range of dates, or by removing the older logs from the parsing all together.

It's pretty amazing how much information is collected.


Posted by: Equanimity Jan 15 2004, 08:00 PM

Well, regardless of my little gripes about the data used, which you addressed as easily fixed, I have to say that our server would be improved significantly with the level of detail and data that these programs can track. Simply amazing.

Incidentally, I loved seeing the obscene lead Liz had over everyone else...reminded me of some good times.

Posted by: JayBaen Jan 15 2004, 08:09 PM

No kidding,

And that's the advantage of a parser like this one -- it really measures accuracy as well as frags (note the "best of" page).


... also, the "alias list" we're coming up with will be of great help to this effort, as we can lump many aliases under one name (as I've done with some of ours already).

Posted by: Equanimity Jan 15 2004, 08:48 PM

Ok, another complicated suggestion from someone who knows nothing about the topic. biggrin.gif

Why not link each IP to one name, that name being the name that is MOST FREQUENTLY associated with the IP. For example, I may appear on the server as Padawan, but I'm more often there as -=RJ=-Equanimity, so, that would be the name associated with my IP.

Also, I looked again at the "best of" section, but I don't seem to see any mention of accuracy. Where are you seeing this?

Posted by: JayBaen Jan 16 2004, 06:31 AM

Accuracy is how the "ranking" is calculated at all.

Check the FAQ page to see the description of the calc.


Posted by: Equanimity Jan 16 2004, 07:54 AM

AEStats seems pretty comprehensive. What features would you say it is missing?

I see on their website that they offer a free public download, but I'm not sure if this is a full version or not. Is this one of the free programs or do they charge for it?

Posted by: Ruggiero Jan 16 2004, 10:38 AM

"The interesting thing," the rodian said in his own self-interest, "is that there are two ways of calculating rank. The previous version of a stats monitor had Jay and Rugg on top... Perhaps this one has different ways of calculating ranks... and perhaps it could be presented a bit more intuitively...."

And with that the assembled jedis collectively force-pushed him off the mountaintop.


Posted by: JayBaen Jan 16 2004, 03:03 PM

Actually, had I been able to cumulatively parse the logs with the other stats engines, they probably would have turned out similarly.

Note: I've removed the older logs and only parsed the ones from the last three days to save Rugg's ego. Recheck


Posted by: Equanimity Jan 16 2004, 06:42 PM

Having these stats could pose one could attract people who would join the server solely to get themselves ranked. While it is GOOD to be in the company of competitive people, I think it could have a negative impact on the overall ambience of the server if our normal business were constantly interrupted by twelve year old children trying to prove their self-worth by proclaiming what "1337" duelers they all are.

Just a thought, but I still love the idea, especially if we can be sure that only mature people will be using it. smile.gif

Posted by: JayBaen Jan 17 2004, 10:58 AM

We can never be sure of anythng ...

If we simply conduct our business as usual, life should be fine. I'm all for the competitive play, in fact, we need more of it.

We've all had fun poking at each other with and it hasn't caused any 'issues' as of yet .. smile.gif

Step 2 of all this is to write a parser of our own to pull IP addresses for admin purposes (we're not finding ANYTHING out there that does this) ... then, we'll be in business.


Posted by: Equanimity Jan 17 2004, 12:30 PM

It's not us or our regulars that I worry about. wink.gif But...again, when the time comes, we will deal. I just like playing devil's advocate from time to time. biggrin.gif

Powered by Invision Power Board (
© Invision Power Services (WDYL-WTN Release)