Add result without had all log on line, is possible?

Avatar
  • updated
  • Answered
I'm evaluating WebLog Expert using the enterprise version currently. I should analyze my log every day but i can't get on line the log more then one day. Every night a batch move log files on tape. Is possible analyze today's log and add result on previous report without having yesterday logs?
Avatar
Michael
It seems that there are a lot of errors with different requested URL and/or referrer. The program needs to load all these lines to memory to create the table, and if too much memory is required, the program cannot generate the report.

The hosts report probably isn't shown because you checked the "Disable host reporting to reduce memory usage" setting in the program options as I suggested above.
Avatar
francesco clementi
I ran the program manually and i disable other error from report content and all work fine, but i don't understand why. Also i don't understand why cannot see hosts content in the reports even if it is selected.

Thank you again
Francesco
Avatar
Michael
It seems that you ran the program from the command line with the -s parameter so it didn't show the error. If you wish to get information on errors you can either remove this parameter or use the -FromScheduler parameter instead. In the latter case you can view information on errors in the Schedule dialog using the View Log button.
Avatar
francesco clementi
Yes, i use command line. I started my profile manually and i got this error during Creating report:

Cannot load data from cache file... Too much memory is required to load report table "Errors > Other Error > Other Errors". You can disable this table and associated charts in Options > Profile Properties > Report > Custom Report contents.

I dont' understand i the proble is only on Errors report. I will try without them.
Avatar
Michael
It's quite strange, the program should show an error dialog if a problem occurs. The program also opens the report after analysis by default, do you have this setting (in Profile Properties > Reports) enabled and do the program tries to open the report after the analysis?

If you use the command line mode and the program just closed without an error, maybe the program crashed during analysis. In this case I recommend you to try to run the analysis manually. You should also check that you use the latest version (7.5). If you use the Enterprise edition now, you should also try to set the report destination to "Web server" to create dynamic HTML reports instead of static ones.
Avatar
francesco clementi
Hi Michael,
i tried everythings you said and now i have another problem, how you understand my logs are very large and i tried to set all report possible in the profile->Reports. The analysis end correctly but in the reports folder i can't find any folder (e.g. last.... or months), i can't find index.htm too. Probably there is any error but i don't know how to see it.

If i select only summary report all work fine.

Thank you again
Avatar
francesco clementi
Hi Michael,
i tried to read a zip format and it work great. You know something about the performance of analysis when i will have 300/500GB of zip file? How can activate dynamic report with trial version?

Thank you again
Avatar
Michael
We considered adding support for using log cache as an archive with ability to delete old log files but decided not to implement this feature. The main problem is that the program is very customizable and supports a lot of settings that affect analysis results. E.g. it is possible to modify predefined report tables in the program options or create new filters in the profile properties. If any of such settings is changed, WebLog Expert needs to reanalyze all the log files to create a new report, it cannot just use an existing database. So it is still necessary to keep old log files in this case. And as log files should be kept anyway, we decided to always generate reports for existing log files only to avoid confusion.

However, you can compress log files as WebLog Expert can read compressed logs directly from ZIP, GZip and BZip2 archives. Logs are compressed very good so compressed logs will require 10-20 times less space on the hard drive.
Avatar
francesco clementi
Hi Micheal,
but i don't understand why? I have about 4,2 GB per Day of logs. (about 23 GB per Week). If i want produce a report of one year i must have 1,3 TB on line?? Isn't there other why to make available report of last 3 year without all those files on line??

Thank you
Regards
Francesco Clementi
Avatar
Michael
No, you need to keep all log files for which you need to get a report.