load balanced, multiple log files

Avatar
danpotepa
  • updated
  • Answered
I have two apache servers and 1 logfile oper day, per server. Do I just create multi-source (one per server) and just add all the files to their related server,

i.e. source 1 contains /logs/server39/*.gz
source 2 contains /logs/server40/*.gz
Replies 9
Avatar
0
Michael
Yes, you need to create multiple log locations (one per server) in Profile Properties > Log Files. You also need to enable the "Analyze log files from load balanced servers" setting below the log location list (it is available in the Professional and Enterprise editions).
Avatar
0
richpaul7
I did this, but it's only analyzing the first log source. I verified this by creating another profile with only the first server's log source and the page view numbers match

I'm using the demo version of Enterprise 7.5
Avatar
0
Michael
You should try to analyze the second source only, maybe the program cannot find any information in these logs (e.g. because of incorrect log format).
Avatar
0
richpaul7
Thanks Michael, I made a profile with just the 2nd source and it worked fine, and gave different page views (as it should). So I know the 2nd source is good.

any other ideas?
Avatar
0
Michael
There should be some problems with profile settings, e.g. because of incorrect path enetered for the second source, filters used or some other options.

Could you send us the program settings (you can save them using the File > Backup command) and reports for the profiles with both sources and just one source, so we'll check what could cause the issue? Our email is support@weblogexpert.com
Avatar
0
richpaul7
I'll work on getting the config, but I think it has something to do with my date macros.

I have one log file per date. When I analyze I don't want to include today's log file because the day is not over. So I was trying to tell the program to only analyze up to yesterday's date. So I added %Date-1% to the log source but maybe I did it wrong. Maybe you can help with this

my log file for 2/17/12 is called u_ex120217.log
my log file for 2/16/12 is called u_ex120216.log
etc.

What would I enter for the log source to get all log files older than 1 day?
Avatar
0
Michael
Date macros won't work in this case. I recommend you to set the program to analyze all the logs but set time range in Profile Propertie > Time Range to "Last 1000 full days". In this case the program won't analyze the last day, just last 1000 full days (hopefully 1000 days is enough in your case to analyze all the required activity).
Avatar
0
richpaul7
This is working for me now. But I actually don't want to analyze only the last x days. I do the first time, but moving forward I want to analyze the last x full days that haven't already been analyzed. I don't want it to have to analyze everything again, including the days it hasn't analyzed. It seems like it's analyzing everything each time, not just the new logs
Avatar
0
Michael
The program can analyze new files only automatically but it will only work if you set time range to "All activity".

I think that the best solution in your case will be to compress log files to .zip archives each day (e.g. u_ex120217.log should be compressed to u_ex120217.zip). You can use Windows Task Scheduler with a script or batch file to automate this task. After it you can just set the program to analyze .zip logs only so logs for the current day won't be analyzed (and log files will require less disk space).