kernel oops 2.6.10

[Andrew Walters]

Harald Barth wrote:

>> If you would like i can paste the call trace. I have read about this 
>> happening in the 2.2.1 kernel, but this is a 2.6.10 kernel.
>>
>
> 2.6.10, you are on the bleeding edge. We need more info. We'd like to
> know the function callback trace. We'd like to know if you are running
> a stock 2.6.10 or have any vendor specific patches. SMP? Then just out
> of curiosity we'd like to know the distro. And if you can provoke the
> oops with debugging turned on (look for nnpfsdebug in the
> documentation) we'd be glad to see the debugging output.
>
> Harald.
>
>
I've got alot of debugging info. I'll post what looks relevant since 
alot looks like it is repeating itself. By the way, I am running 
slackware current(well pretty close, i only update the packages I use) 
and a self-compiled kernel not SMP.

I can send you my entire log starting with a reboot if i didn't give 
enough. I have arla starting up with the system and it only takes about 
5 min to go out but the log is still incredibly long, 99% arla messages 
though.


Stuff at the begining, I believe it works through all of this:

Feb 10 02:55:45 amwalters kernel: nnpfs_pioctl
Feb 10 02:55:45 amwalters kernel: nnpfs_fh_to_dentry: dev: 3145730 
inode: 423012
Feb 10 02:55:45 amwalters kernel: fhopen_call: returns fd: 10
Feb 10 02:55:45 amwalters kernel: nnpfs_syscall returns error: 10
Feb 10 02:55:45 amwalters kernel: sys_afs kernel unlock; cpu: 0
Feb 10 02:55:45 amwalters kernel: sys_afs locking kernel; cpu: 0
Feb 10 02:55:45 amwalters kernel: sys_afs kernel locked; cpu: 0
Feb 10 02:55:45 amwalters kernel: sys_afs operation: 20 a_pathP: 
00000000 a_opcode: 1074550331 a_paramsP: deea3fa8 a_followSymlinks: 0
Feb 10 02:55:45 amwalters kernel: nnpfs_pioctl
Feb 10 02:55:45 amwalters kernel: nnpfs_fh_to_dentry: dev: 3145730 
inode: 423012
Feb 10 02:55:45 amwalters kernel: fhopen_call: returns fd: 10
Feb 10 02:55:45 amwalters kernel: nnpfs_syscall returns error: 10
Feb 10 02:55:45 amwalters kernel: sys_afs kernel unlock; cpu: 0
Feb 10 02:55:45 amwalters kernel: nnpfs_message_receive opcode = 5
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode
Feb 10 02:55:45 amwalters kernel: xn_lookup: enter 1.536870919.1.1
Feb 10 02:55:45 amwalters kernel: xn_lookup: hashvalue = 184
Feb 10 02:55:45 amwalters kernel: xn_lookup: found node df7da580
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: dp: 
de898780 aliases: /(d7de84b0)(unhashed)
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: fetching 
new node
Feb 10 02:55:45 amwalters kernel: new_nnpfs_node 1.536889195.1.1
Feb 10 02:55:45 amwalters kernel: xn_lookup: enter 1.536889195.1.1
Feb 10 02:55:45 amwalters kernel: xn_lookup: hashvalue = 298
Feb 10 02:55:45 amwalters kernel: xn_lookup: exit
Feb 10 02:55:45 amwalters kernel: nnpfs_iget sb: de89e600 node: d81b0120 
newnode: df7da680
Feb 10 02:55:45 amwalters kernel: xn_insert: enter 1.536889195.1.1
Feb 10 02:55:45 amwalters kernel: xn_insert: exit
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: inode: 
cc0629f0 tokens: 0x10 aliases:
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: alias d7de84b0
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: lookup 
00000000
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: allocated 
new entry: c896e910
Feb 10 02:55:45 amwalters kernel: nnpfs_d_init: dentry: c896e910
Feb 10 02:55:45 amwalters kernel: nnpfs_d_delete: dentry 
c896e910(nd.edu): all references dropped
Feb 10 02:55:45 amwalters kernel: nnpfs_message_installnode: done 
installing
Feb 10 02:55:45 amwalters kernel: nnpfs_put_inode: inode: cc0629f0 
count: 2 aliases: nd.edu(c896e910)
Feb 10 02:55:45 amwalters kernel: nnpfs_message_receive opcode = 1
Feb 10 02:55:45 amwalters kernel: nnpfs_message_wakeup error: 0 seq = 9
Feb 10 02:55:45 amwalters kernel: nnpfs_message_rpc wakeup: seq = 12
Feb 10 02:55:45 amwalters kernel: nnpfs_message_rpc opcode 
this_process->error_or_size = 0
Feb 10 02:55:45 amwalters kernel: nnpfs_message_rpc opcode 
((nnpfs_message_wakeup*)(this_process->message))->error = 0


Here's where I think the error starts:

Feb 10 03:07:29 amwalters kernel: nnpfs_pioctl
Feb 10 03:07:29 amwalters kernel: nnpfs_fh_to_dentry: dev: 3145730 
inode: 423018
Feb 10 03:07:29 amwalters kernel: Unable to handle kernel NULL pointer 
dereference at virtual address 00000000
Feb 10 03:07:29 amwalters kernel: printing eip:
Feb 10 03:07:29 amwalters kernel: 00000000
Feb 10 03:07:29 amwalters kernel: *pde = 00000000
Feb 10 03:07:29 amwalters kernel: Oops: 0000 [#1]
Feb 10 03:07:29 amwalters kernel: PREEMPT SMP
Feb 10 03:07:29 amwalters kernel: Modules linked in: nnpfs
Feb 10 03:07:29 amwalters kernel: CPU: 0
Feb 10 03:07:29 amwalters kernel: EIP: 0060:[<00000000>] Not tainted VLI
Feb 10 03:07:29 amwalters kernel: EFLAGS: 00010202 (2.6.10)
Feb 10 03:07:29 amwalters kernel: EIP is at 0x0
Feb 10 03:07:29 amwalters kernel: eax: c05c52c0 ebx: 00000000 ecx: 
00000000 edx: c8542038
Feb 10 03:07:29 amwalters kernel: esi: dbe84514 edi: c17ee800 ebp: 
deea3fa8 esp: deea3628
Feb 10 03:07:29 amwalters kernel: ds: 007b es: 007b ss: 0068
Feb 10 03:07:29 amwalters kernel: Process arlad (pid: 3306, 
threadinfo=deea3000 task=deff9520)
Feb 10 03:07:29 amwalters kernel: Stack: e0ee9e79 dbe84514 0006746a 
0006746a 00000000 00000010 e0eedd0d deea3674
Feb 10 03:07:29 amwalters kernel: 00300002 0006746a 00134f24 00000050 
deea3674 fffffff2 00000000 e0ee9f4e
Feb 10 03:07:29 amwalters kernel: deea3674 b6a1d850 00000050 00300002 
0006746a 00134f24 00000000 00000000
Feb 10 03:07:29 amwalters kernel: Call Trace:
Feb 10 03:07:29 amwalters kernel: [<e0ee9e79>] 
nnpfs_fh_to_dentry+0x119/0x170 [nnpfs]
Feb 10 03:07:29 amwalters kernel: [<e0ee9f4e>] fhopen_call+0x7e/0x130 
[nnpfs]
Feb 10 03:07:29 amwalters kernel: [<e0eea62f>] sys_afs_int+0x3ff/0x550 
[nnpfs]
Feb 10 03:07:29 amwalters kernel: [<c02efc80>] memmove+0x50/0x60
Feb 10 03:07:29 amwalters kernel: [<c01b2b3b>] 
leaf_copy_items_entirely+0x1db/0x240
Feb 10 03:07:29 amwalters kernel: [<c02efc80>] memmove+0x50/0x60
Feb 10 03:07:29 amwalters kernel: [<c01b6ee1>] search_by_key+0x821/0x11d0
Feb 10 03:07:29 amwalters kernel: [<c01b2b3b>] 
leaf_copy_items_entirely+0x1db/0x240
Feb 10 03:07:29 amwalters kernel: [<c02efc10>] memset+0x0/0x20
Feb 10 03:07:29 amwalters kernel: [<c02efc80>] memmove+0x50/0x60
Feb 10 03:07:29 amwalters kernel: [<c01b39c5>] 
leaf_insert_into_buf+0x1c5/0x270
Feb 10 03:07:29 amwalters kernel: [<c019ada2>] balance_leaf+0xdc2/0x2ff0
Feb 10 03:07:29 amwalters kernel: [<c01ab097>] ip_check_balance+0x2c7/0xb80
Feb 10 03:07:29 amwalters kernel: [<c04b0ef3>] 
__ip_conntrack_find+0x13/0xc0
Feb 10 03:07:29 amwalters kernel: [<c04b1261>] 
ip_conntrack_tuple_taken+0x31/0x40
Feb 10 03:07:29 amwalters kernel: [<c04b7afb>] ip_nat_used_tuple+0x2b/0x40
Feb 10 03:07:29 amwalters kernel: [<c04b806b>] get_unique_tuple+0xab/0x1c0
Feb 10 03:07:29 amwalters kernel: [<c04b0ef3>] 
__ip_conntrack_find+0x13/0xc0
Feb 10 03:07:29 amwalters kernel: [<c04b0a9b>] ip_ct_invert_tuple+0x2b/0x30
Feb 10 03:07:29 amwalters kernel: [<c04b83bf>] 
ip_nat_setup_info+0x23f/0x280
Feb 10 03:07:29 amwalters kernel: [<c045ec14>] kfree_skbmem+0x24/0x30
Feb 10 03:07:29 amwalters kernel: [<c045eca3>] __kfree_skb+0x83/0x120
Feb 10 03:07:29 amwalters kernel: [<c04feaff>] packet_rcv_spkt+0x13f/0x250
Feb 10 03:07:29 amwalters kernel: [<c0394b7d>] e100_xmit_frame+0x17d/0x2e0
Feb 10 03:07:29 amwalters kernel: [<c0472607>] qdisc_restart+0x17/0x1f0
Feb 10 03:07:29 amwalters kernel: [<c0464965>] dev_queue_xmit+0x145/0x270
Feb 10 03:07:29 amwalters kernel: [<c046a853>] 
neigh_resolve_output+0xd3/0x1c0
Feb 10 03:07:29 amwalters kernel: [<c04803df>] ip_finish_output2+0xaf/0x1b0
Feb 10 03:07:29 amwalters kernel: [<c0480330>] ip_finish_output2+0x0/0x1b0
Feb 10 03:07:29 amwalters kernel: [<c046fb91>] nf_hook_slow+0xf1/0x130
Feb 10 03:07:29 amwalters kernel: [<c0480330>] ip_finish_output2+0x0/0x1b0
Feb 10 03:07:29 amwalters kernel: [<c0480300>] dst_output+0x0/0x30
Feb 10 03:07:29 amwalters kernel: [<c047dd95>] ip_finish_output+0x205/0x210
Feb 10 03:07:29 amwalters kernel: [<c0480330>] ip_finish_output2+0x0/0x1b0
Feb 10 03:07:29 amwalters kernel: [<c0480300>] dst_output+0x0/0x30
Feb 10 03:07:29 amwalters kernel: [<c0480314>] dst_output+0x14/0x30
Feb 10 03:07:29 amwalters kernel: [<c046fb91>] nf_hook_slow+0xf1/0x130
Feb 10 03:07:29 amwalters kernel: [<c0480300>] dst_output+0x0/0x30
Feb 10 03:07:29 amwalters kernel: [<c0480300>] dst_output+0x0/0x30
Feb 10 03:07:29 amwalters kernel: [<c047fe7b>] 
ip_push_pending_frames+0x3fb/0x460
Feb 10 03:07:29 amwalters kernel: [<c0480300>] dst_output+0x0/0x30
Feb 10 03:07:29 amwalters kernel: [<c049c4fc>] 
udp_push_pending_frames+0x16c/0x2a0
Feb 10 03:07:29 amwalters kernel: [<c049c974>] udp_sendmsg+0x2f4/0x6d0
Feb 10 03:07:29 amwalters kernel: [<c04a4a6d>] inet_sendmsg+0x4d/0x60
Feb 10 03:07:29 amwalters kernel: [<c045aaaa>] sock_sendmsg+0xda/0x100
Feb 10 03:07:29 amwalters kernel: [<c0133480>] 
autoremove_wake_function+0x0/0x60
Feb 10 03:07:29 amwalters kernel: [<c045aaaa>] sock_sendmsg+0xda/0x100
Feb 10 03:07:29 amwalters kernel: [<c0119954>] 
find_busiest_group+0xd4/0x300
Feb 10 03:07:29 amwalters kernel: [<c0118fac>] finish_task_switch+0x3c/0x90
Feb 10 03:07:29 amwalters kernel: [<c051acc7>] schedule+0x3e7/0xc20
Feb 10 03:07:29 amwalters kernel: [<c0118fac>] finish_task_switch+0x3c/0x90
Feb 10 03:07:29 amwalters kernel: [<c011a717>] __wake_up_locked+0x27/0x30
Feb 10 03:07:29 amwalters kernel: [<c051a740>] __down+0xd0/0xe0
Feb 10 03:07:29 amwalters kernel: [<c011a600>] 
default_wake_function+0x0/0x20
Feb 10 03:07:29 amwalters kernel: [<c0127663>] 
del_singleshot_timer_sync+0x13/0x40
Feb 10 03:07:29 amwalters kernel: [<c051a877>] __down_failed+0x7/0xc
Feb 10 03:07:29 amwalters kernel: [<c016fc74>] poll_freewait+0x44/0x50
Feb 10 03:07:29 amwalters kernel: [<c0170009>] do_select+0x1b9/0x2e0
Feb 10 03:07:29 amwalters kernel: [<c02f00ee>] copy_to_user+0x3e/0x50
Feb 10 03:07:29 amwalters kernel: [<e0ee37d4>] nnpfs_devread+0xf4/0x190 
[nnpfs]
Feb 10 03:07:29 amwalters kernel: [<c018aaba>] dnotify_parent+0x3a/0xb0
Feb 10 03:07:29 amwalters kernel: [<e0eea7bc>] sys_afs+0x3c/0x80 [nnpfs]
Feb 10 03:07:29 amwalters kernel: [<c01031af>] syscall_call+0x7/0xb
Feb 10 03:07:29 amwalters kernel: Code: Bad EIP value.
Feb 10 03:07:29 amwalters kernel: ode: df7da680
Feb 10 03:07:29 amwalters kernel: clear_all_children parent: nd.edu
Feb 10 03:07:29 amwalters kernel: clear_all_children child: user33 
inode: cc0629f0/ca5a10b0 dcount: 1 aliases:
Feb 10 03:07:29 amwalters kernel: user33(c896e884)
Feb 10 03:07:29 amwalters kernel: nnpfs_force_invalid_xnode: df7da880
Feb 10 03:07:29 amwalters kernel: clear_all_children parent: awalter1
Feb 10 03:07:29 amwalters kernel: clear_all_children child: .directory 
inode: ca5a11e8/00000000 dcount: 1 aliases:
Feb 10 03:07:29 amwalters kernel: nnpfs_force_invalid_xnode: df7da580
Feb 10 03:07:29 amwalters kernel: clear_all_children parent: /
Feb 10 03:07:29 amwalters kernel: clear_all_children child: nd.edu 
inode: de898780/cc0629f0 dcount: 1 aliases:
Feb 10 03:07:29 amwalters kernel: nd.edu(c896e910)
Feb 10 03:07:29 amwalters kernel: nnpfs_force_invalid_xnode: df7daa80
Feb 10 03:07:29 amwalters kernel: clear_all_children parent: user33
Feb 10 03:07:29 amwalters kernel: clear_all_children child: awalter1 
inode: ca5a10b0/ca5a11e8 dcount: 2 aliases:
Feb 10 03:07:29 amwalters kernel: awalter1(c896e99c)


Stuff at the end:

Feb 10 03:07:29 amwalters kernel: nnpfs_lookup: getnode rpc done, 
dentry: cb54dc58
Feb 10 03:07:29 amwalters kernel: error -19nnpfs_d_delete: dentry 
c896e99c(awalter1): all references dropped
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:07:29 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:07:29 amwalters kernel: find_pag: Did not find pag
Feb 10 03:07:29 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:07:29 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:07:29 amwalters kernel: nnpfs_access(01) = -19
Feb 10 03:08:14 amwalters kernel: nnpfs_getattr
Feb 10 03:08:14 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:08:14 amwalters kernel: find_pag: Did not find pag
Feb 10 03:08:14 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:08:14 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:10:13 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:10:13 amwalters kernel: find_pag: Did not find pag
Feb 10 03:10:13 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:10:13 amwalters kernel: nnpfs_access (de898780) mode = 01 
aliases: /(d7de84b0)(unhashed)
Feb 10 03:10:13 amwalters kernel: find_pag: ngroups = 7
Feb 10 03:10:13 amwalters kernel: find_pag: Did not find pag
Feb 10 03:10:13 amwalters kernel: nnpfs_get_pag_group: returning 500
Feb 10 03:10:13 amwalters kernel: nnpfs_message_rpc opcode = 6
Feb 10 03:10:13 amwalters kernel: nnpfs_access(01) = -19