I am using Logparser to parse IIS logs into SQL. I am trying to use iCheckpoint to avoid duplicate entries. The query works, but when I run the query again, the SQL table doubles and the same entries are added. So it seems it is not picking up from where it left off. I'm just using test logs so nothing is being added to them so I assume no entries should be added to the table.
Here is my query
LogParser "SELECT TO_TIMESTAMP(date, time) AS date, SUBSTR(cs-uri-query, 8) AS csuriquery, cs(Referer) INTO TestTable FROM C:\TestLogs\u_ex*.log WHERE cs-uri-stem = '/Index.Aspx' AND cs-method <> 'POST' AND cs(User-Agent) NOT IN (SELECT cs(User-Agent) FROM C:\TestLogs\bots.list)" -i:IISW3C -iCheckPoint:C:\TestLogs\checkPoint.lpc -o:SQL -server:testServer -database:TestDB
Thanks