Add result without had all log on line, is possible?

Avatar
  • updated
  • Answered
I'm evaluating WebLog Expert using the enterprise version currently. I should analyze my log every day but i can't get on line the log more then one day. Every night a batch move log files on tape. Is possible analyze today's log and add result on previous report without having yesterday logs?
Avatar
Michael
Analysis of such amount of data may require a lot of time, it depends on log contents, selected reports and computer used so it is difficult to estimate it.

I think that for such amount of data it is better to create a report for month only as in other case the database will be very large and it could cause performance issues, while it depends on reports selected. I also recommend you to disable hosting reporting if it is not required by checking the "Disable host reporting to reduce memory usage" setting in the program options.

You need to do the following to create dynamic reports for profiles:

1. Click the Server button on the toolbar to show the Server dialog.

2. Click the Run button to start the server.

3. Click “Manage” near “Users” and add a new user with access rights for all profiles. You will need to enter the specified username and password to access the generated dynamic reports.

4. Click “Manage” near “Profiles marked for publishing” and select the profiles you wish to get the dynamic reports for.

After it when you analyze these profiles, you’ll get dynamic HTML reports.
Avatar
Michael
No, you need to keep all log files for which you need to get a report.
Avatar
francesco clementi
Hi Micheal,
but i don't understand why? I have about 4,2 GB per Day of logs. (about 23 GB per Week). If i want produce a report of one year i must have 1,3 TB on line?? Isn't there other why to make available report of last 3 year without all those files on line??

Thank you
Regards
Francesco Clementi
Avatar
Michael
We considered adding support for using log cache as an archive with ability to delete old log files but decided not to implement this feature. The main problem is that the program is very customizable and supports a lot of settings that affect analysis results. E.g. it is possible to modify predefined report tables in the program options or create new filters in the profile properties. If any of such settings is changed, WebLog Expert needs to reanalyze all the log files to create a new report, it cannot just use an existing database. So it is still necessary to keep old log files in this case. And as log files should be kept anyway, we decided to always generate reports for existing log files only to avoid confusion.

However, you can compress log files as WebLog Expert can read compressed logs directly from ZIP, GZip and BZip2 archives. Logs are compressed very good so compressed logs will require 10-20 times less space on the hard drive.
Avatar
francesco clementi
Hi Michael,
i tried to read a zip format and it work great. You know something about the performance of analysis when i will have 300/500GB of zip file? How can activate dynamic report with trial version?

Thank you again
Avatar
francesco clementi
Hi Michael,
i tried everythings you said and now i have another problem, how you understand my logs are very large and i tried to set all report possible in the profile->Reports. The analysis end correctly but in the reports folder i can't find any folder (e.g. last.... or months), i can't find index.htm too. Probably there is any error but i don't know how to see it.

If i select only summary report all work fine.

Thank you again
Avatar
Michael
It's quite strange, the program should show an error dialog if a problem occurs. The program also opens the report after analysis by default, do you have this setting (in Profile Properties > Reports) enabled and do the program tries to open the report after the analysis?

If you use the command line mode and the program just closed without an error, maybe the program crashed during analysis. In this case I recommend you to try to run the analysis manually. You should also check that you use the latest version (7.5). If you use the Enterprise edition now, you should also try to set the report destination to "Web server" to create dynamic HTML reports instead of static ones.
Avatar
francesco clementi
Yes, i use command line. I started my profile manually and i got this error during Creating report:

Cannot load data from cache file... Too much memory is required to load report table "Errors > Other Error > Other Errors". You can disable this table and associated charts in Options > Profile Properties > Report > Custom Report contents.

I dont' understand i the proble is only on Errors report. I will try without them.
Avatar
Michael
It seems that you ran the program from the command line with the -s parameter so it didn't show the error. If you wish to get information on errors you can either remove this parameter or use the -FromScheduler parameter instead. In the latter case you can view information on errors in the Schedule dialog using the View Log button.
Avatar
francesco clementi
I ran the program manually and i disable other error from report content and all work fine, but i don't understand why. Also i don't understand why cannot see hosts content in the reports even if it is selected.

Thank you again
Francesco