請問資料擷取問題 - Linux

By Ina
at 2013-10-15T19:19
at 2013-10-15T19:19
Table of Contents
我有一個檔案是記錄一些log的..檔名叫做Test_log
但是這檔案大於10mb,會把Test_log 存成Test_log1
之後再收到的log,會繼續存成新的Test_log
如果在有檔案在大餘10mb,就會將原本的Test_log1刪除,再將Test_log存成Test_log1
大約就是這個模式在記錄log...
我為了讓這個log都能保存下來...所以我寫了一個簡單的Script放在crontab
大概指令如下
cat Test_log Test_log1 > Test_long_log
diff Test_log Test_long_log > Test_diff_log
cp Test_long_log Test_long_log1
cat Test_diff_log Test_long_log1 >> Test_long_log
現在遇到一個問題 Test_long_log,檔案越來越大,
目前已經達到4gb了,所以我在windows也開不起來了
而這些log,都是記錄我一些sensor data,格式大約如下
2013-Oct-10 11:01:02 sensor1,sensor2,sensor3
2013-Oct-10 11:01:06 sensor1,sensor2,sensor3
2013-Oct-10 11:01:09 sensor1,sensor2,sensor3
.
.
.
2013-Oct-10 11:01:13 sensor1,sensor2,sensor3
因為這些sensor資料,我大約每個小時只需要一筆即可...
是否有機會依照小時去做資料擷取..
或是更簡單一點,每100行,我只需要截取第一行即可...
是否有其他方式去讓我log能完整保留,因為如果真的可以每100行只保留一行
那我需要面對另一個問題是,如何算是哪個些資料是新增的,要將他寫入 Test_long_log
請網友幫幫忙..謝謝
--
Tags:
Linux
All Comments

By Dora
at 2013-10-19T17:46
at 2013-10-19T17:46

By Xanthe
at 2013-10-20T09:49
at 2013-10-20T09:49

By Doris
at 2013-10-20T10:55
at 2013-10-20T10:55

By Liam
at 2013-10-21T02:12
at 2013-10-21T02:12

By Yedda
at 2013-10-24T19:24
at 2013-10-24T19:24

By Kama
at 2013-10-27T23:20
at 2013-10-27T23:20

By Blanche
at 2013-10-29T03:47
at 2013-10-29T03:47

By Daniel
at 2013-10-31T16:23
at 2013-10-31T16:23

By Zanna
at 2013-11-01T23:08
at 2013-11-01T23:08

By Anonymous
at 2013-11-05T09:04
at 2013-11-05T09:04

By James
at 2013-11-09T17:58
at 2013-11-09T17:58

By Skylar DavisLinda
at 2013-11-12T16:24
at 2013-11-12T16:24

By Erin
at 2013-11-13T10:04
at 2013-11-13T10:04

By Sarah
at 2013-11-15T12:24
at 2013-11-15T12:24

By Belly
at 2013-11-19T06:15
at 2013-11-19T06:15

By Blanche
at 2013-11-21T01:41
at 2013-11-21T01:41

By Doris
at 2013-11-22T06:47
at 2013-11-22T06:47

By Ula
at 2013-11-24T01:03
at 2013-11-24T01:03

By Poppy
at 2013-11-26T08:04
at 2013-11-26T08:04

By Poppy
at 2013-11-30T18:17
at 2013-11-30T18:17

By Edward Lewis
at 2013-12-02T05:19
at 2013-12-02T05:19

By Caroline
at 2013-12-03T18:26
at 2013-12-03T18:26

By Susan
at 2013-12-07T23:12
at 2013-12-07T23:12

By Sierra Rose
at 2013-12-11T00:25
at 2013-12-11T00:25

By Jacob
at 2013-12-13T23:20
at 2013-12-13T23:20

By Andy
at 2013-12-18T17:48
at 2013-12-18T17:48

By Joseph
at 2013-12-23T00:41
at 2013-12-23T00:41

By Daph Bay
at 2013-12-23T17:01
at 2013-12-23T17:01

By Elvira
at 2013-12-24T21:33
at 2013-12-24T21:33

By Selena
at 2013-12-25T11:10
at 2013-12-25T11:10

By Ula
at 2013-12-26T08:03
at 2013-12-26T08:03

By David
at 2013-12-26T17:08
at 2013-12-26T17:08

By Brianna
at 2013-12-30T00:21
at 2013-12-30T00:21

By Elizabeth
at 2013-12-31T03:48
at 2013-12-31T03:48
Related Posts
外接硬碟(ext4)的檔案權限

By Suhail Hany
at 2013-10-15T19:07
at 2013-10-15T19:07
限制只有部分USER能從外部連線?

By Joseph
at 2013-10-15T16:25
at 2013-10-15T16:25
syslog-ng怎麼過濾儲存非本機的Log

By Harry
at 2013-10-15T15:12
at 2013-10-15T15:12
apt-get安裝紀錄 以及 分割磁碟

By Ethan
at 2013-10-15T15:11
at 2013-10-15T15:11
位址 0xOO3 0xOB

By Regina
at 2013-10-15T14:37
at 2013-10-15T14:37