Hello: I have a Java program that is trying to import over 8 million rows from a text file. When the program starts up, it runs fine, but after a while it begins to crawl. This is usually symptomatic of a machine that started swapping, but take a look at the attached output from top. I am using a LOT of memory, but the swap is still very low. I don't think the machine should be paging to disk. The CPU states show that the cpus are spending most of their time in an idle state. The process list shows the postmaster and java processes are less than 10 percent the CPU cycles. Having said that, the load average is still about 2. Any ideas what could be going on? Thanks, Neil -- Neil Aggarwal, (214)986-3533, www.JAMMConsulting.com FREE! Eliminate junk email and reclaim your inbox. Visit http://www.spammilter.com for details.
top - 10:40:57 up 6 days, 24 min, 2 users, load average: 1.95, 2.11, 2.10
Tasks: 87 total, 1 running, 86 sleeping, 0 stopped, 0 zombie
Cpu0 : 0.5% us, 0.2% sy, 0.0% ni, 96.8% id, 2.6% wa, 0.0% hi, 0.0% si
Cpu1 : 0.6% us, 0.2% sy, 0.0% ni, 91.6% id, 7.7% wa, 0.0% hi, 0.0% si
Cpu2 : 0.4% us, 0.1% sy, 0.0% ni, 98.6% id, 0.9% wa, 0.0% hi, 0.0% si
Cpu3 : 0.4% us, 0.1% sy, 0.0% ni, 96.7% id, 2.7% wa, 0.0% hi, 0.0% si
Mem: 4151420k total, 4130104k used, 21316k free, 16484k buffers
Swap: 10241336k total, 164k used, 10241172k free, 3999476k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
21408 postgres 16 0 36504 27m 26m S 6 0.7 10:42.42 postmaster
21398 root 17 0 2201m 18m 8284 S 2 0.4 3:48.50 java
21491 postgres 15 0 53680 30m 25m D 2 0.8 1:06.01 postmaster
1 root 16 0 2020 528 452 S 0 0.0 0:00.89 init
2 root RT 0 0 0 0 S 0 0.0 0:00.05 migration/0
3 root 34 19 0 0 0 S 0 0.0 0:00.00 ksoftirqd/0
4 root RT 0 0 0 0 S 0 0.0 0:00.05 migration/1
5 root 34 19 0 0 0 S 0 0.0 0:00.00 ksoftirqd/1
6 root RT 0 0 0 0 S 0 0.0 0:00.83 migration/2
7 root 34 19 0 0 0 S 0 0.0 0:00.00 ksoftirqd/2
8 root RT 0 0 0 0 S 0 0.0 0:00.77 migration/3
9 root 34 19 0 0 0 S 0 0.0 0:00.00 ksoftirqd/3
10 root 5 -10 0 0 0 S 0 0.0 0:00.20 events/0
11 root 5 -10 0 0 0 S 0 0.0 0:00.00 events/1
12 root 5 -10 0 0 0 S 0 0.0 0:00.00 events/2
13 root 5 -10 0 0 0 S 0 0.0 0:00.00 events/3
14 root 7 -10 0 0 0 S 0 0.0 0:00.00 khelper
15 root 15 -10 0 0 0 S 0 0.0 0:00.00 kacpid
46 root 5 -10 0 0 0 S 0 0.0 0:00.00 kblockd/0
47 root 5 -10 0 0 0 S 0 0.0 0:00.00 kblockd/1
48 root 5 -10 0 0 0 S 0 0.0 0:00.00 kblockd/2
49 root 5 -10 0 0 0 S 0 0.0 0:00.00 kblockd/3
67 root 15 0 0 0 0 S 0 0.0 0:03.06 pdflush
68 root 15 0 0 0 0 S 0 0.0 0:07.13 pdflush
70 root 11 -10 0 0 0 S 0 0.0 0:00.00 aio/0
71 root 11 -10 0 0 0 S 0 0.0 0:00.00 aio/1
72 root 11 -10 0 0 0 S 0 0.0 0:00.00 aio/2
73 root 11 -10 0 0 0 S 0 0.0 0:00.00 aio/3
50 root 15 0 0 0 0 S 0 0.0 0:00.00 khubd
69 root 15 0 0 0 0 S 0 0.0 0:06.60 kswapd0
217 root 25 0 0 0 0 S 0 0.0 0:00.00 kseriod
332 root 5 -10 0 0 0 S 0 0.0 0:00.02 ata/0
333 root 5 -10 0 0 0 S 0 0.0 0:00.01 ata/1
334 root 5 -10 0 0 0 S 0 0.0 0:00.00 ata/2
335 root 5 -10 0 0 0 S 0 0.0 0:00.01 ata/3
341 root 23 0 0 0 0 S 0 0.0 0:00.00 scsi_eh_0
342 root 23 0 0 0 0 S 0 0.0 0:00.00 scsi_eh_1
385 root 15 0 0 0 0 S 0 0.0 0:02.04 md4_raid1
387 root 15 0 0 0 0 S 0 0.0 0:00.00 md3_raid1
389 root 15 0 0 0 0 S 0 0.0 0:00.06 md1_raid1
390 root 15 0 0 0 0 S 0 0.0 0:00.05 md0_raid1
392 root 15 0 0 0 0 S 0 0.0 0:00.00 md2_raid1
393 root 15 0 0 0 0 S 0 0.0 0:03.78 kjournald
1664 root 6 -10 2028 492 404 S 0 0.0 0:00.01 udevd
1715 root 24 0 0 0 0 S 0 0.0 0:00.00 shpchpd_event
1950 root 6 -10 0 0 0 S 0 0.0 0:00.00 kauditd
2086 root 7 -10 0 0 0 S 0 0.0 0:00.00 kmirrord
2114 root 19 0 0 0 0 S 0 0.0 0:00.00 kjournald
2115 root 15 0 0 0 0 D 0 0.0 3:28.85 kjournald
2116 root 15 0 0 0 0 S 0 0.0 0:00.13 kjournald
2838 root 16 0 2384 552 456 S 0 0.0 0:00.73 syslogd
2842 root 16 0 2720 380 316 S 0 0.0 0:00.13 klogd
2852 root 16 0 1572 300 220 S 0 0.0 0:00.00 irqbalance
2870 rpc 15 0 2360 548 452 S 0 0.0 0:00.00 portmap
2889 root 16 0 3448 728 620 S 0 0.0 0:00.00 rpc.statd
2901 root 16 0 3348 332 252 S 0 0.0 0:00.00 mdadm
2930 root 16 0 5672 528 272 S 0 0.0 0:00.00 rpc.idmapd
2999 root 15 0 3272 508 300 S 0 0.0 0:00.07 smartd
3008 root 18 0 2188 492 416 S 0 0.0 0:00.00 acpid
3089 root 16 0 4520 1140 836 S 0 0.0 0:01.27 sshd
3102 root 18 0 3076 756 624 S 0 0.0 0:00.00 xinetd
3120 root 16 0 7892 2020 984 S 0 0.0 0:00.01 sendmail
3128 smmsp 16 0 7036 1632 812 S 0 0.0 0:00.00 sendmail
3138 root 16 0 3140 460 384 S 0 0.0 0:00.00 gpm
3147 root 16 0 6332 936 536 S 0 0.0 0:00.00 crond
3164 root 16 0 2448 424 308 S 0 0.0 0:00.00 atd
3173 dbus 17 0 3580 956 812 S 0 0.0 0:00.05 dbus-daemon-1
3182 root 16 0 8828 6724 1516 S 0 0.2 2:03.53 hald
3279 root 18 0 2124 440 380 S 0 0.0 0:00.00 mingetty
3280 root 18 0 1788 440 380 S 0 0.0 0:00.00 mingetty
3281 root 18 0 2380 436 380 S 0 0.0 0:00.00 mingetty
3282 root 18 0 1660 440 380 S 0 0.0 0:00.00 mingetty
3283 root 18 0 2052 440 380 S 0 0.0 0:00.00 mingetty
3284 root 18 0 1932 440 380 S 0 0.0 0:00.00 mingetty
6681 postgres 16 0 35620 3080 2792 S 0 0.1 0:00.27 postmaster
6682 postgres 16 0 7072 744 452 S 0 0.0 0:00.38 postmaster
6684 postgres 16 0 35748 25m 25m S 0 0.6 2:42.52 postmaster
6685 postgres 16 0 7636 1184 512 S 0 0.0 0:00.31 postmaster
11948 root 16 0 8560 2008 1568 S 0 0.0 0:00.00 cupsd
17141 root 16 0 8020 2464 1824 S 0 0.1 0:01.58 sshd
17701 root 15 0 4916 1520 1216 S 0 0.0 0:00.08 bash
21375 root 16 0 5472 904 752 S 0 0.0 0:00.00 screen
21376 root 16 0 5660 1044 656 S 0 0.0 0:00.02 screen
21377 root 15 0 5252 1504 1196 S 0 0.0 0:00.02 bash
21394 root 15 0 5252 772 460 S 0 0.0 0:00.00 bash
21500 root 16 0 4640 1488 1192 S 0 0.0 0:00.03 bash
21681 root 15 0 2072 876 704 R 0 0.0 0:00.00 top