Logfile Parser Application seeking advice

DaveS · August 10, 2013, 3:32pm

You can also just subtract minutes… the DateObject is smarter than most people give it credit

d.minute=d.minute-5

and yes it adjusts the hours, days etc.

Lee_Page · August 11, 2013, 11:29am

thanks Dave

Almost there i think. Just struggling to work out how to use the mid() function. I need to stop parsing the log file in this example where dt.SQLDateTime = less than 2013-08-11 07:47:36

[code] dim d as new date
dim time_now as string = d.SQLDateTime

/////////////// 2013-08-11 07:52:36

dim dt as new date
dt.Totalseconds = dt.Totalseconds - 300 // add wanted number of seconds to date
dim time_then as string = dt.SQLDateTime

/////////////// 2013-08-11 07:47:36

Dim f As FolderItem
Dim textInput As TextInputStream
Dim rowFromFile As String
Dim count As Integer =0

f = GetFolderItem(“c:\ex130725.log”)

// From IIS Log File
// 2013-08-11 07:52:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 07:50:12 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 07:48:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /demo.aspx?
// 2013-08-11 04:52:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 03:11:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /test.aspx?
// 2013-08-11 02:52:33 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?

If f <> Nil Then
textInput =TextInputStream.Open(f)
textInput.Encoding=Encodings.UTF8
Do
if instr(0,textInput.ReadLine, “BJLive/Default.aspx?”) > 0 then
count = count + 1
Label1.text = Str(count)
end if
Loop Until textInput.EOF
textInput.Close
End If[/code]

DaveS · August 11, 2013, 1:47pm

  dim dt  as new date
 dim dt2 as new date
dim s a string
  dt.Totalseconds = dt.Totalseconds - 300 // add wanted number of seconds to date

  /////////////// 2013-08-11 07:47:36
  
  Dim f As FolderItem
  Dim textInput As TextInputStream
  Dim rowFromFile As String
  Dim count As Integer =0
  
  f = GetFolderItem("c:\\ex130725.log")


If f <> Nil Then
    textInput =TextInputStream.Open(f)
    textInput.Encoding=Encodings.UTF8
    Do
        s=textInput.ReadLine
         dt2=sqldatetime(left(trim(s),19)
         if dt2.totalseconds < dt.totalseconds then exit do
  if instr(s, "BJLive/Default.aspx?") > 0 then
        count = count + 1
     
      end if
    Loop Until textInput.EOF
    textInput.Close
  End If
   Label1.text = Str(count)

no need to update label everytime count increments… just when you have a final answer

Lee_Page · August 11, 2013, 7:03pm

Dave you are a life saver. Thanks so much.

Pick a charity, I will donate some money online for people less fortunate than us. will CC you in on the thankyou email.

dt2=sqldatetime(left(trim(s),19)
throws me a syntax error have looked at the LR but it’s not that helpfull

Alex_von_Siebenthal · August 11, 2013, 7:30pm

What syntax error?

Wayne_Golding · August 11, 2013, 7:31pm

I can see it’s missing a )

DaveS · August 11, 2013, 8:47pm

I do that a lot lately

dt2=sqldatetime(left(trim(s),19))

Wayne_Golding · August 11, 2013, 11:31pm

If you’re using a windows IDE it may not be you.

Does it still throw the syntax error?

Lee_Page · August 12, 2013, 7:43am

Hi All

Using either of the two lines of code below.

dt2=sqldatetime(left(trim(s),19) - ‘syntax error’
dt2=sqldatetime(left(trim(s),19)) - This method or property does not exist.

[quote] dim dt as new date
dim dt2 as new date
dim s as string
dt.Totalseconds = dt.Totalseconds - 300 // add wanted number of seconds to date

Dim f As FolderItem
Dim textInput As TextInputStream
Dim rowFromFile As String
Dim count As Integer =0

f = GetFolderItem(“c:\ex130725.log”)

If f <> Nil Then
textInput =TextInputStream.Open(f)
textInput.Encoding=Encodings.UTF8
Do
s=textInput.ReadLine
// dt2=sqldatetime(left(trim(s),19)
// dt2=sqldatetime(left(trim(s),19))
if dt2.totalseconds < dt.totalseconds then exit do
if instr(s, “BJLive/Default.aspx?”) > 0 then
count = count + 1

  end if
Loop Until textInput.EOF
textInput.Close

End If
Label1.text = Str(count)[/quote]

Thanks Lee

Alex_von_Siebenthal · August 12, 2013, 8:01am

Have you defined the function sqldatetime?

Lee_Page · August 12, 2013, 8:43am

Sorry still a novice and learning albeit slowly. Do you mean a property?

Simon_Berridge · August 12, 2013, 8:59am

I think the code is wrong. Dave wrote:

dt2=sqldatetime(left(trim(s),19)

and I think it should be:

dt2.sqldatetime = (left(trim(s),19)

Also, I think that Dave’s code:

[code]if dt2.totalseconds < dt.totalseconds then exit do

if instr(s, “BJLive/Default.aspx?”) > 0 then
count = count + 1
end if[/code]

should be written:

if dt2.totalseconds >= dt.totalseconds then if instr(s, "BJLive/Default.aspx?") > 0 then count = count + 1 end if end if

Lee_Page · August 12, 2013, 9:12am

and I think it should be: dt2.sqldatetime = (left(trim(s),19)

Looks as though the closing bracket is needed

and I think it should be: dt2.sqldatetime = (left(trim(s),19))

Compiles but
dt2.sqldatetime = (left(trim(s),19))

throws “UnsupportedFormatException”

Lee_Page · August 12, 2013, 12:19pm

Is this a bug? have tried console app too and dropped back to 2012 version still getting “UnsupportedFormatException”

Alex_von_Siebenthal · August 12, 2013, 12:56pm

Try:

dt2.SQLDateTime = trim(s).Left(19)

Lee_Page · August 12, 2013, 1:21pm

  dt2.SQLDateTime = trim(s).Left(19)

“UnsupportedFormatException”

J_Andrew_Lipscomb · August 12, 2013, 1:25pm

Check what “s” is at that moment. An UnsupportedFormatException means that somehow, you’ve fed the SQLDateTime property a string that does not match the format of an SQLDateTime. (I’m wondering also if there’s an encoding issue involving UTF16–I’ve been bitten by that one before.)

Test code:

dim tempString as String tempString = trim(s).Left(19) dt2.SQLDateTime = tempString
And watch what the value of tempString is.

Lee_Page · August 13, 2013, 7:53am

had to rewind a little. All getting a little confusing for my tired brain…

[code]
dim s as string
dim d as new date
dim date_time_now as string = d.SQLDateTime
MsgBox(date_time_now)
/////////////// 2013-08-11 07:52:36

dim dt as new date
dt.Totalseconds = dt.Totalseconds - 300 // add wanted number of seconds to date
dim date_time_then as string = dt.SQLDateTime
MsgBox(date_time_then)
/////////////// 2013-08-11 07:47:36

Dim f As FolderItem
Dim textInput As TextInputStream
Dim rowFromFile As String
Dim count As Integer =0

f = GetFolderItem(“c:\ex130725.log”)

// From IIS Log File
// 2013-08-11 07:52:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 07:50:12 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 07:48:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /demo.aspx?
// 2013-08-11 04:52:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?
// 2013-08-11 03:11:36 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /test.aspx?
// 2013-08-11 02:52:33 W3SVC1 CHI-PROD-LTW-1 172.24.50.30 GET /BJLive/Default.aspx?

If f <> Nil Then
textInput =TextInputStream.Open(f)
textInput.Encoding=Encodings.UTF8
Do

  dim tempString as String
  s=textInput.ReadLine
  tempString = trim(s).Left(19)
  MsgBox(tempString)
  
  //Returns correct trim from readline
  //2013-08-11 07:52:36 
  
  ///######  TRYING TO DO THIS
  ///######  If "BJLive/Default.aspx?" exist in "s" and "s" date_time_then is NO greater than date_time_now. Then Add to the count.
  
 
  if instr(s, "BJLive/Default.aspx?") > 0 then
    count = count + 1
    Label1.text = Str(count)
  end if
Loop Until textInput.EOF
textInput.Close

End If[/code]

I am sure it’s just some clever little one liner or two to accomplish this…

Thanks again for any help

Lee

Alex_von_Siebenthal · August 13, 2013, 8:21am

What’s your question?

Lee_Page · August 13, 2013, 8:28am

If anybody can help with a code snippet to do this below. I just can’t work out a way.

///###### If “BJLive/Default.aspx?” exist in “s” and “s” date_time_then is NO greater than date_time_now. Then Add to the count.

Where’s Norman when you need him