« Previous Next »

Thread: zipped csv files as input

Last post 09-11-2008 8:39 AM by gluegood. 5 replies.

Average Rating Rate It (5)

RSS

Page 1 of 1 (6 items)

Sort Posts:

  • 06-19-2008, 6:53 AM

    zipped csv files as input

     Hi

    Any plugin available that will allow to parse zipped files?

     Jürg

  • 06-19-2008, 8:32 AM In reply to

    Re: zipped csv files as input

    I haven't heard of any, but why not run a batch file that unzips the file, LogParses it then rezips it?

    Jeff

    Look for Wrox's new book Professional IIS 7 in your local bookstore, or order now at Amazon.com
  • 06-19-2008, 11:53 AM In reply to

    Re: zipped csv files as input

     Thanks, but I am looking at 100'000 possible files in the TB range and I have no room to unzip them all before parsing

  • 06-24-2008, 7:52 AM In reply to

    Re: zipped csv files as input

    Hi,

    Log Parser supports reading input data from the input stream, for example.

    type filename.csv | LogParser "SELECT * FROM STDIN" -i:CSV

    Perhaps you can output csv data to the I/O pipe since unzipping those data requires large disk space for storing before parsing.

     

    Zhao Ji Ma
    Sincerely,
    Microsoft Online Community Support

    “Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. ”
  • 06-24-2008, 11:36 AM In reply to

    Re: zipped csv files as input

     Thanks

     I can't howevr yet not figure out how it could help me. My files are zipped csv log files and it would be very handy to e.g. count the number of special events logged in the files.

    The files have talking names so to analyze a certain month I could use:

    SELECT count(*) from *200805*.zip WHERE Field1="011" group by SUBSTR(Filename,1,5)

    I agree that I could first use a -i:FS run to get the list of files, run an unzipper with these files, then run log parser and thereafter clean up but - in this scenario - how much more efficient would it be to be able to specify -i:CSVZIP or some other syntax.

    The ultimate solution would of course be that logparser recognizes zipped files automatically and unpacks them before processing?

    As of my knowledge zip/unzip libraries are available but would need to be used from within logparser.

    Jürg

  • 09-11-2008, 8:39 AM In reply to

    Re: zipped csv files as input

    See my post (or blog site) in the LogParser Advanced forum regarding a VB.NET freeware Log Parser custom input plug-in that can run Log Parser queries inside of ZIP files. 

    Should address your needs.

    Thanks
    Gluegood 

Page 1 of 1 (6 items)
Microsoft Communities