Advanced
Mailing List Archive

Mailing List Archive

  1. Home >
  2. Cisco>
  3. NAS
memory Problems on a Cisco 3640
acm at netuse
Sep 1, 2003, 5:48 AM
Post #1 of 3 (1329 views)
Permalink
Hi!

I have a memory Problem with my Cisco 3640.
There are 4 x 32 MB RAM inside.

How can I find out, which module is faulty ?
Here an output from show version and show memory.

Cisco Internetwork Operating System Software
IOS (tm) 3600 Software (C3640-I-M), Version 12.2(19), RELEASE SOFTWARE (fc3)
Copyright (c) 1986-2003 by cisco Systems, Inc.
Compiled Tue 12-Aug-03 19:39 by kellmill
Image text-base: 0x60008930, data-base: 0x60A38000

ROM: System Bootstrap, Version 11.1(19)AA, EARLY DEPLOYMENT RELEASE
SOFTWARE (fc1)

***** uptime is 18 hours, 26 minutes
System returned to ROM by processor memory parity error at PC
0x6064B26C, address 0x0 at 20:19:49 MEST Sun Aug 31 2003
System restarted at 20:20:42 MEST Sun Aug 31 2003
System image file is "flash:c3640-i-mz.122-19"

cisco 3640 (R4700) processor (revision 0x00) with 125952K/5120K bytes of
memory.
Processor board ID 10131087
R4700 CPU at 100Mhz, Implementation 33, Rev 1.0
Channelized E1, Version 1.0.
MICA-6DM Firmware: CP ver 2940 - 7/24/2002, SP ver 2940 - 7/24/2002.
Bridging software.
X.25 software, Version 3.0.0.
Primary Rate ISDN software, Version 1.1.
1 FastEthernet/IEEE 802.3 interface(s)
31 Serial network interface(s)
12 terminal line(s)
1 Channelized E1/PRI port(s)
DRAM configuration is 64 bits wide with parity enabled.
125K bytes of non-volatile configuration memory.
24576K bytes of processor board System flash (Read/Write)

Configuration register is 0x2102


router#sh mem
router#sh memory
Head Total(b) Used(b) Free(b) Lowest(b)
Largest(b)
Processor 61091AA0 111600992 5852760 105748232 105459380
105714716
I/O 7B00000 5243080 2692572 2550508 2550508
2494684




Processor memory

Address Bytes Prev Next Ref PrevF NextF Alloc PC what
61091AA0 0000020000 00000000 610968EC 001 -------- -------- 603F6210
Managed Chunk Queue Elements
610968EC 0000001500 61091AA0 61096EF4 001 -------- -------- 60405658
List Elements
61096EF4 0000005000 610968EC 610982A8 001 -------- -------- 60405698
List Headers
610982A8 0000009000 61096EF4 6109A5FC 001 -------- -------- 604242DC
Interrupt Stack




Thanks for any hints,
Ahmad Cheikh-Moussa
--
Ahmad Cheikh-Moussa
NetUSE AG
Dr.-Hell-Stra?e, 24107 Kiel, Federal Republic of Germany
Telefon: +49 431 386435 00 -- Telefax: +49 431 386435 99
Service: Service@NetUSE.DE -- http://NetUSE.DE/
Re: memory Problems on a Cisco 3640 [ In reply to ]
dpeng at cisco
Sep 2, 2003, 2:01 PM
Post #2 of 3 (1330 views)
Permalink
Do you have console logs from when the parity error occurred? Without
this or the crashinfo (which I don't think is supported on the 3640 in
12.2 mainline), it would be hard to say.

Dennis

Ahmad Cheikh Moussa [acm@netuse.de] wrote:
> Hi!
>
> I have a memory Problem with my Cisco 3640.
> There are 4 x 32 MB RAM inside.
>
> How can I find out, which module is faulty ?
> Here an output from show version and show memory.
>
> Cisco Internetwork Operating System Software
> IOS (tm) 3600 Software (C3640-I-M), Version 12.2(19), RELEASE SOFTWARE (fc3)
> Copyright (c) 1986-2003 by cisco Systems, Inc.
> Compiled Tue 12-Aug-03 19:39 by kellmill
> Image text-base: 0x60008930, data-base: 0x60A38000
>
> ROM: System Bootstrap, Version 11.1(19)AA, EARLY DEPLOYMENT RELEASE
> SOFTWARE (fc1)
>
> ***** uptime is 18 hours, 26 minutes
> System returned to ROM by processor memory parity error at PC
> 0x6064B26C, address 0x0 at 20:19:49 MEST Sun Aug 31 2003
> System restarted at 20:20:42 MEST Sun Aug 31 2003
> System image file is "flash:c3640-i-mz.122-19"
>
> cisco 3640 (R4700) processor (revision 0x00) with 125952K/5120K bytes of
> memory.
> Processor board ID 10131087
> R4700 CPU at 100Mhz, Implementation 33, Rev 1.0
> Channelized E1, Version 1.0.
> MICA-6DM Firmware: CP ver 2940 - 7/24/2002, SP ver 2940 - 7/24/2002.
> Bridging software.
> X.25 software, Version 3.0.0.
> Primary Rate ISDN software, Version 1.1.
> 1 FastEthernet/IEEE 802.3 interface(s)
> 31 Serial network interface(s)
> 12 terminal line(s)
> 1 Channelized E1/PRI port(s)
> DRAM configuration is 64 bits wide with parity enabled.
> 125K bytes of non-volatile configuration memory.
> 24576K bytes of processor board System flash (Read/Write)
>
> Configuration register is 0x2102
>
>
> router#sh mem
> router#sh memory
> Head Total(b) Used(b) Free(b) Lowest(b)
> Largest(b)
> Processor 61091AA0 111600992 5852760 105748232 105459380
> 105714716
> I/O 7B00000 5243080 2692572 2550508 2550508
> 2494684
>
>
>
>
> Processor memory
>
> Address Bytes Prev Next Ref PrevF NextF Alloc PC what
> 61091AA0 0000020000 00000000 610968EC 001 -------- -------- 603F6210
> Managed Chunk Queue Elements
> 610968EC 0000001500 61091AA0 61096EF4 001 -------- -------- 60405658
> List Elements
> 61096EF4 0000005000 610968EC 610982A8 001 -------- -------- 60405698
> List Headers
> 610982A8 0000009000 61096EF4 6109A5FC 001 -------- -------- 604242DC
> Interrupt Stack
>
>
>
>
> Thanks for any hints,
> Ahmad Cheikh-Moussa
> --
> Ahmad Cheikh-Moussa
> NetUSE AG
> Dr.-Hell-Stra?e, 24107 Kiel, Federal Republic of Germany
> Telefon: +49 431 386435 00 -- Telefax: +49 431 386435 99
> Service: Service@NetUSE.DE -- http://NetUSE.DE/
>
> _______________________________________________
> cisco-nas mailing list
> cisco-nas@puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nas
Re: memory Problems on a Cisco 3640 [ In reply to ]
acm at netuse
Sep 2, 2003, 11:11 PM
Post #3 of 3 (1340 views)
Permalink
Hi!

Here an output from the crashfile.
Thanks for your help.


Aug 31 20:18:02.600 MEST: %LINEPROTO-5-UPDOWN: Line protocol on
Interface Serial0/0:22, changed state to down
Error: primary data cache, fields: tag,
virtual addr 0x6160D27E, physical addr(21:3) 0x20D278, vAddr(14:12) 0x1000
virtual address corresponds to main:heap, cache word 3

Low Data High Data Par Low Data High Data Par
L1 Data : 0:0x00000000 0x00000000 0x12E 1:0x00000000 0x00000000 0x00
2:0x000000AD 0x00000000 0x10 3:0x00000000 0x00000000 0x00

Low Data High Data Par Low Data High Data Par
DRAM Data: 0:0x00000000 0x00000000 0x00 1:0x00000000 0x00000000 0x00
2:0x000000AD 0x00000000 0x10 3:0x00000000 0x00000000 0x00

Unexpected exception, CPU signal 20, PC = 0x6064B26C


-Traceback= 604234B4 6064BEA0
$0 : 00000000, AT : 00000000, v0 : 6160C220, v1 : 60EA899C
a0 : 6160D27E, a1 : BAE40000, a2 : F8465700, a3 : 6162391E
t0 : 21BEDE00, t1 : 00000009, t2 : 000000CB, t3 : FFFF00FF
t4 : 000000AD, t5 : 0000000C, t6 : 07C7337A, t7 : 6160A337
s0 : 6160A214, s1 : 61208E80, s2 : 616237EC, s3 : 61208ED0
s4 : 61208ED4, s5 : 61208EDC, s6 : 00000005, s7 : 6160A214
t8 : 07C73833, t9 : 00000040, k0 : 3040F001, k1 : 30410000
gp : 60EEC4C0, sp : 61208E50, s8 : 61208F28, ra : 6064BEA0
EPC : 604234B4, ErrorEPC : 6064B26C, SREG : 3400FF05
Cause 00000000 (Code 0x0): Interrupt exception

No fault history 0xFFFFFFFF. Need 11.1 (2) or higher ROM


=== Start of Crashinfo Collection (20:19:49 MEST Sun Aug 31 2003) ===

For image:
Cisco Internetwork Operating System Software
IOS (tm) 3600 Software (C3640-I-M), Version 12.2(19), RELEASE SOFTWARE (fc3)
Copyright (c) 1986-2003 by cisco Systems, Inc.
Compiled Tue 12-Aug-03 19:39 by kellmill



========= Show Alignment =============================



No alignment data has been recorded.

No spurious memory references have been recorded.


========= Malloc and Free Traces=====================

MallocFree Trace: ixmallocfree=0x11 ptr=0x61036C78
61036BF0: 616130B4 40000498 616130B4 600DA03C 616130B4 600D9F08 61613A0C
600004C8
61036C10: 616249E4 600D9F48 61624A2C 6000000E 61606B5C 3000001E 61606B5C
60474D70
61036C30: 61606B5C 60474F54 61606B5C 3000001E 61606B5C 60474D70 61606B5C
60474F54
61036C50: 61606B5C 3000001E 61606B5C 60474D70 616248F8 40000016 616248F8
6047661C
61036C70: 614E0918 30000016 614E0918 60479334 616159C0 60591FB0 615E43BC
60591D34
61036C90: 6146E1C0 4000015E 6146E1C0 603AE110 7CB1BE0 200032CC 7CB1BE0
603AE250
61036CB0: 615DFA38 4000015E 615DFA38 603AE110 7CBEEA0 2000326C 7CBEEA0
603AE250
61036CD0: 615EAB10 4000015E 615EAB10 603AE110 7C974A0 2000346C 7C974A0
603AE250
61036CF0: 616249E4 40000010 616249E4 600D9FC0 6161C3F8 40000498 6161C3F8
600DA03C
61036D10: 616248F8 40000010 616248F8 600D9FC0 615E4660 30000016 615E4660
600DA03C
61036D30: 615E4660 600D9F08 616248F8 600D9F48 61624940 60000014 6161C3F8
600D9F08
61036D50: 6161CD50 60000276 616249E4 600D9F48 61624A2C 6000000E 612D452C
605844CC
61036D70: 615E4660 30000016 615E4660 605836D0 61606B5C 60583950 612D452C
30000032
61036D90: 612D452C 60584434 616159C0 20000042 616159C0 605742DC 616248F8
40000010
61036DB0: 616248F8 600D9FC0 61606B5C 3000001E 61606B5C 600DA03C 61606B5C
600D9F08
61036DD0: 616248F8 600D9F48 61624940 60000014 616249E4 40000010 616249E4
600D9FC0
========== Stack Trace========

-Traceback= 604234B4 6064BEA0

========= Context ======================

3600 Software (C3640-I-M), Version 12.2(19), RELEASE SOFTWARE (fc3)
Compiled Tue 12-Aug-03 19:39 by kellmill
Signal = 20, Code = 0x9020D279, Uptime 09:16:00
$0 : 00000000, AT : 00000000, v0 : 6160C220, v1 : 60EA899C
a0 : 6160D27E, a1 : BAE40000, a2 : F8465700, a3 : 6162391E
t0 : 21BEDE00, t1 : 00000009, t2 : 000000CB, t3 : FFFF00FF
t4 : 000000AD, t5 : 0000000C, t6 : 07C7337A, t7 : 6160A337
s0 : 6160A214, s1 : 61208E80, s2 : 616237EC, s3 : 61208ED0
s4 : 61208ED4, s5 : 61208EDC, s6 : 00000005, s7 : 6160A214
t8 : 07C73833, t9 : 00000040, k0 : 3040F001, k1 : 30410000
gp : 60EEC4C0, sp : 61208E50, s8 : 61208F28, ra : 6064BEA0
EPC : 604234B4, ErrorEPC : 6064B26C, SREG : 3400FF05
Cause : 00000000, BadVaddr : 30211FBF

Error: primary data cache, fields: tag,
virtual addr 0x6160D27E, physical addr(21:3) 0x20D278, vAddr(14:12) 0x1000
virtual address corresponds to main:heap, cache word 3

Low Data High Data Par Low Data High Data Par
L1 Data : 0:0x00000000 0x00000000 0x12E 1:0x00000000 0x00000000 0x00
2:0x000000AD 0x00000000 0x10 3:0x00000000 0x00000000 0x00

Low Data High Data Par Low Data High Data Par
DRAM Data: 0:0x00000000 0x00000000 0x00 1:0x00000000 0x00000000 0x00
2:0x000000AD 0x00000000 0x10 3:0x00000000 0x00000000 0x00
========= Stack Dump ==========================

Stack Frame Pointer in Context is 0x61208E50, at process level

61208A50: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208A70: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208A90: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208AB0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208AD0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208AF0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208B10: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208B30: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208B50: 0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 1
0
61208B70: 0 61208CA4 0 FFFFFFFF B 60363290 FFFFFFFF
FFFFFFFF
61208B90: 7FFFFFFF 60F9CD40 7FFFFFF3 61208CC0 61208CD8 FFFFFFFF C
6036370C
61208BB0: 343131FF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61208BD0: 61208BAF FFFFFFFF 0 0 0 FFFFFFFF 1
20
61208BF0: FFFFFFFF FFFFFFFF 61208CE4 1 0 0 0
FFFFFFFF
61208C10: FFFFFFFF 20 0 FFFFFFFF 0 61208CD8 40
0
61208C30: 0 FFFFFFFF 7FFFFFFF 0 FFFFFFFF 603622AC 7FFFFFFF
60F9CD40
61208C50: 603CF5F8 0 0 FFFFFFFF 7FFFFFFF 0 603E1A54
603622AC
61208C70: 60F9CD4C 18 610BCDB0 18 611AC0F8 611ACBF4 611AC39C
611AC308
61208C90: 611AC0F8 3C FFF6 60BF0000 603B4D08 C3F4F0FE 604D2440
6124BB04
61208CB0: 6125ADC4 C3F4F0FE C3F4F0FE 0 4 0 1
610BCDB0
61208CD0: 611ACE38 611ADE00 6002EFA0 6002E68C 6 1D 0
611AC39C
61208CF0: 611AC308 611AC0F8 8300FFC4 C3F4F0FE 611AC0F8 0 611ACE38
610BCDB0
61208D10: 611ACDA0 3C 611ACD9C 611ACE34 6002F39C 1 611ACE38
610BCDB0
61208D30: 611ACDA0 3C 614F3C50 1 FF03 603BD8D0 6124BE24
0
61208D50: 6124BE24 C1626E01 0 7B0084A 1 612635AC 1
611AC0F8
61208D70: 60BD28C0 611AC0F8 0 7B00858 6126EED4 6133B988 61604760
0
61208D90: 6133A59C 2C 1 10 6126E90C 613D04EC 615DAA70
0
61208DB0: 0 2C 1 613CFF8C 60370000 603B27D8 2C
AC1F0010
61208DD0: 0 6126EED4 60503C8C 6133A6EC 60505E38 6133A6EC 4
7C69320
61208DF0: 0 6126E90C 615D97D4 613CF250 60505E38 613CF250 0
2C
61208E10: 1 613CFF8C 60506A7C 60506A68 615D97D4 6126EED4 1
615E62BC
61208E30: 6126E90C 6126E90C 61226E2C 6126E90C 612DC404 6126E90C 22
613CF250
61208E50: 0 6126E90C 22 603DEC40 20 61208ED8 0
6064BEA0
61208E70: 613CF250 0 611B8BA8 613CF250 5DE 611B8340 69E
610B13B8
61208E90: 6160A204 5DE 61208F20 61274E38 616237E8 61208F24 606550C0
601540AC
61208EB0: 603AEB30 612725C0 0 1 6160A214 5 0
0
61208ED0: 7C73256 616237EC 5DE 69E 0 610B13B8 1
6160A204
61208EF0: 61274E38 0 0 0 0 60654B0C 613CFEF8
603BE5E0
61208F10: 603CF5F8 6062AE50 61208F28 1 80000000 0 5DE
0
61208F30: 61274E38 610B13B8 610B13B8 0 610B2654 0 0
613B0A20
61208F50: 0 606528C0 613CF250 6126E90C 1 61209020 61274E38
21
61208F70: 605FBD2C 615DA510 60370000 60688CE4 603CF5F8 1 611ACE38
61276E04
61208F90: 1 6126E90C 603E1A54 1 615DA514 603BE51C 615D97D4
FF00
61208FB0: 60531544 1 0 7C692F4 D943E66E 610BDFE0 1
615D97D4
61208FD0: 60BD28C0 615D97D4 0 61274E38 610B2654 7C73258 610B13B8
61274E38
61208FF0: 1 0 0 603B27D8 6125F584 C3F4EE47 0
61274E38
61209010: 604C7ED4 34 0 61209020 0 6124BE24 1
7C692F8
61209030: 450005DC 2E854000 3306A1A8 D943E66E C3F4EE47 C3F4EE47 5DC
5DC
61209050: 0 0 61274E38 610B2654 61080000 7C73258 61080000
7C7324A
61209070: 1 604B6188 604C84E8 611AD394 604CA81C 0 6107FF30
61274E38
61209090: 610B2654 611AD394 0 7C73258 604B7254 604B6DD8 60BF0000
61050000
612090B0: 2 604C0ED8 61278808 613C4670 0 0 0
60507758
612090D0: 604D6DC0 604D6D28 20000 60C1C9C0 0 1FD06FC 61278808
613C4670
612090F0: 61278808 0 20000 61209144 61274E38 0 61080000
5EA
61209110: 60BF0000 7C7324A 611AC0F8 604B566C 0 1FD3A8C 0
0
61209130: 0 7C7324A 0 0 612091C8 0 60BF0000
611AC0F8
61209150: 60405FE0 7C73258 611AD394 612094B4 0 0 612091C0
3E
61209170: 60BF0000 612091CC 612091C8 61050000 60BF0000 61050000 2
604B583C
61209190: 6040C028 FFFFFFFF 612091C0 927BF 612091C0 927BF 61050000
604B5A14
612091B0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 0 1FD3A8C 2
0
612091D0: 0 0 0 0 0 0 0
0
612091F0: 0 603F05D0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 603F05BC
FFFFFFFF
61209210: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
61209230: FFFFFFFF FD0110DF AB1234CD 20 61209260 60BF7144 6041F584
6120948C

========= Process Level Info ==================

---- Current Process Block (at 0x61209260) ----

61209238: AB1234CD 20 61209260 60BF7144 6041F584 6120948C 61206340
80000116
61209258: 1 0 61206354 80007CD8 604B5920 0 61050000
612094B4
61209278: 0 0 612091C8 61050000 60BF0000 61050000 2
61209210
61209298: 0 6040AE7C 0 0 0 0 10000
100
612092B8: 0 0 0 20 0 0 3BAD8
A6B8
612092D8: 258C 0 0 1FC502C 0 0 56534
0
612092F8: 0 1FD0710 0 1FD0710 A2E42 0 60C18AC0
3
61209318: B9 12E1 155D CE7 2EE0 2EE0 6109EED4
0
61209338: 0 0 0 0 0 0 0
0
61209358: 61209260 6104C1B0 0 0 6104C180 0 0
0
61209378: 421C 0 0 0 61209360 0 0
0
61209398: 42A0 61209260 0 0 0 0 61209360
61209260
612093B8: 0 0 142EC 0 0 0 61209360
61209260
612093D8: 0 0 242E4 0 0 0 0
0
612093F8: 0 612094B4 0 0 0 0 0
0
61209418: 0 0 610A9D84 61209514 61209410 612094BC 0
6104CAB0
61209438: 0 0 0 0 0 0 0
FFFFFFF
61209458: FFFFFFF 0 0 0 0 1F412CC 0
0
61209478: 0 61209570 0 BEEFCAFE

---- Partial decode of process block ----

Pid 32: Process "IP Input" stack 0x61206354 savedsp 0x80007CD8
Flags: analyze prefers_new
Status 0x00000000 Orig_ra 0x00000000 Routine 0x00000000 Signal 0
Caller_pc 0x00000000 Callee_pc 0x00000000 Dbg_events 0x00000000 State 0
Totmalloc 244440 Totfree 42680 Totgetbuf 9612
Totretbuf 0 Edisms 0x0 Eparm 0x0
Elapsed 0x56534 Ncalls 0xA2E42 Ngiveups 0x0
Priority_q 3 Ticks_5s 185 Cpu_5sec 4833 Cpu_1min 5469
Cpu_5min 3303 Stacksize 0x2EE0 Lowstack 0x2EE0
Ttyptr 0x6109EED4 Mem_holding 0x0 Thrash_count 0
Wakeup_reasons 0x0FFFFFFF Default_wakeup_reasons 0x0FFFFFFF
Direct_wakeup_major 0x00000000 Direct_wakeup_minor 0x00000000

Regs s0-s8,ra at last suspend; a0,a1,sp from proc creation, PC unused:
a0: 604B5920 a1: 00000000 s0: 61050000 s1: 612094B4 s2: 00000000
s3: 00000000 s4: 612091C8 s5: 61050000 s6: 60BF0000 s7: 61050000
s8: 00000002 sp: 61209210 PC: 00000000 ra: 6040AE7C

---- Current Process Stack (0x6E4 bytes used, out of 0x2EE0 available) ----

Current SP = 0x61208E50, saved SP = 0x80007CD8

61208E34: 6126E90C 61226E2C 6126E90C 612DC404 6126E90C 22 613CF250
0
61208E54: 6126E90C 22 603DEC40 20 61208ED8 0 6064BEA0
613CF250
61208E74: 0 611B8BA8 613CF250 5DE 611B8340 69E 610B13B8
6160A204
61208E94: 5DE 61208F20 61274E38 616237E8 61208F24 606550C0 601540AC
603AEB30
61208EB4: 612725C0 0 1 6160A214 5 0 0
7C73256
61208ED4: 616237EC 5DE 69E 0 610B13B8 1 6160A204
61274E38
61208EF4: 0 0 0 0 60654B0C 613CFEF8 603BE5E0
603CF5F8
61208F14: 6062AE50 61208F28 1 80000000 0 5DE 0
61274E38
61208F34: 610B13B8 610B13B8 0 610B2654 0 0 613B0A20
0
61208F54: 606528C0 613CF250 6126E90C 1 61209020 61274E38 21
605FBD2C
61208F74: 615DA510 60370000 60688CE4 603CF5F8 1 611ACE38 61276E04
1
61208F94: 6126E90C 603E1A54 1 615DA514 603BE51C 615D97D4 FF00
60531544
61208FB4: 1 0 7C692F4 D943E66E 610BDFE0 1 615D97D4
60BD28C0
61208FD4: 615D97D4 0 61274E38 610B2654 7C73258 610B13B8 61274E38
1
61208FF4: 0 0 603B27D8 6125F584 C3F4EE47 0 61274E38
604C7ED4
61209014: 34 0 61209020 0 6124BE24 1 7C692F8
450005DC
61209034: 2E854000 3306A1A8 D943E66E C3F4EE47 C3F4EE47 5DC 5DC
0
61209054: 0 61274E38 610B2654 61080000 7C73258 61080000 7C7324A
1
61209074: 604B6188 604C84E8 611AD394 604CA81C 0 6107FF30 61274E38
610B2654
61209094: 611AD394 0 7C73258 604B7254 604B6DD8 60BF0000 61050000
2
612090B4: 604C0ED8 61278808 613C4670 0 0 0 60507758
604D6DC0
612090D4: 604D6D28 20000 60C1C9C0 0 1FD06FC 61278808 613C4670
61278808
612090F4: 0 20000 61209144 61274E38 0 61080000 5EA
60BF0000
61209114: 7C7324A 611AC0F8 604B566C 0 1FD3A8C 0 0
0
61209134: 7C7324A 0 0 612091C8 0 60BF0000 611AC0F8
60405FE0
61209154: 7C73258 611AD394 612094B4 0 0 612091C0 3E
60BF0000
61209174: 612091CC 612091C8 61050000 60BF0000 61050000 2 604B583C
6040C028
61209194: FFFFFFFF 612091C0 927BF 612091C0 927BF 61050000 604B5A14
FFFFFFFF
612091B4: FFFFFFFF FFFFFFFF FFFFFFFF 0 1FD3A8C 2 0
0
612091D4: 0 0 0 0 0 0 0
0
612091F4: 603F05D0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 603F05BC FFFFFFFF
FFFFFFFF
61209214: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF

========= Interrupt Level Stack Dump ==========
WARNING: Interrupt stack dumps are consistent ONLY for interrupts which
are blocked during exception handling. Also register output is valid
ONLY for interrupts which store an r4k_context block on the stack.

---- Level 1 Interrupt stack (0x6E8 bytes used, out of 0x2328 available)
----

intstacks[1]: base 0x6118A638 stack 0x6118C958 routine 0x0 count
0x1AE487
size 0x2328 low 0x2328 desc 0x60C03ED8

6118C560: 61339520 73 6161ED68 60406958 6063090C 60630904 61209360
18
6118C580: 61209360 18 61209260 2 61209360 6040B214 615EC358
4C
6118C5A0: 611574EC 60152BA4 610A9D74 610A5C08 1 8 6040B800
3C105950
6118C5C0: 8 3C1055D8 610A5C08 613A5120 610A5C08 613A5120 613A5120
6040C0AC
6118C5E0: A 60030D50 615E4CFC FFFFFF 613A5120 603C7370 615EE730
FFFF
6118C600: 8300FFCA 1 61604760 604B43F8 613A5120 8 61339520
603B19C8
6118C620: 60504A8C 1 613A5120 616034C4 604066AC 6133A6EC 616034C4
6133A6EC
6118C640: 60BF0000 610BB4C0 603AF30C 61279398 612DC404 61279398 0
613DBE50
6118C660: 6045137C 61279398 6045137C 603DEC40 604066AC 1 61157340
60E80000
6118C680: 611BA69C 61050000 612093B8 612093A8 61209260 0 611AD394
7C73258
6118C6A0: 61050000 60406958 6158213C 8 61209360 8 61209360
8
6118C6C0: 61209260 2 61209360 6040B214 610A99CC 610A51E8 1
610B13B8
6118C6E0: 610A9D74 610A5C08 1 61274E38 6040B800 610BB748 603AF30C
610B13B8
6118C700: 610A5C08 611AC0F8 610A5C08 611AC0F8 61274E38 6040C0AC 60450DD4
603AE8B4
6118C720: 7C28B8E 60450DD4 61274E38 603C7370 0 611AC0F8 61274E38
61274E38
6118C740: 604B4390 604B4388 1 611AC0F8 6000DA1C 7C28B8C 61274E38
611AC0F8
6118C760: 61274E38 7C7324A 6119A9A8 60BF0000 603C72AC 61157484 6104FC70
61157484
6118C780: 7C28B80 611AF0C0 1 611AC0F8 600293E4 20000 FFFF
6002E424
6118C7A0: 61157484 1 6119C710 1 6104F4D0 6119B174 6045E398
340F9F4
6118C7C0: 3C100394 611B8368 2 0 60F4BC40 1 6104F4D0
0
6118C7E0: 60BF0000 60BF0000 61050000 60BF0000 61050000 6045E72C 61050000
601E03B0
6118C800: 0 0 1 5B77DBE2 5B7717F7 0 60E83C58
60BF0000
6118C820: FFFFFFFF FFFFFFFF 0 61050000 0 0 0
61050000
6118C840: 0 0 0 1FD0710 0 0 0
0
6118C860: 0 0 0 0 0 1 FFFFFFFF
FFFF00FF
6118C880: 0 6041CC70 FD066C4A C3F4F0C3 AC1F0010 190497 B0D6C77
A34B421C
6118C8A0: 0 61050000 0 6104C1F0 FFFFFFFF 80007D88 0
60BF0000
6118C8C0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6118C8E0: 0 6041AB28 0 0 0 3040F001 0
30410000
6118C900: FFFFFFFF FFFFFFFF FFFFFFFF 80007D78 FFFFFFFF FFFFFFFF 0
604234A4
6118C920: 3400FF03 FFFFFFFF FFFFFFFF E4A2F906 FFFFFFFF FCD420E2 FFFFFFFF
FFFFFFFF
6118C940: FFFFFFFF FFFFFFFF 0 604234B4 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
$0 : FFFFFFFF, AT : 61050000, v0 : 00000000, v1 : 61050000
a0 : 00000000, a1 : 01FD0710, a2 : 00000000, a3 : 00000000
t0 : 00000000, t1 : 00000000, t2 : 00000001, t3 : FFFF00FF
t4 : 6041CC70, t5 : C3F4F0C3, t6 : 00190497, t7 : A34B421C
s0 : 61050000, s1 : 6104C1F0, s2 : 80007D88, s3 : 60BF0000
s4 : FFFFFFFF, s5 : FFFFFFFF, s6 : FFFFFFFF, s7 : FFFFFFFF
t8 : 6041AB28, t9 : 00000000, k0 : 3040F001, k1 : 30410000
gp : FFFFFFFF, sp : 80007D78, s8 : FFFFFFFF, ra : 604234A4
EPC : 604234B4, ErrorEPC : FFFFFFFF, SREG : 3400FF03

---- Level 2 Interrupt stack (0x180 bytes used, out of 0x2328 available)
----

intstacks[2]: base 0x6109CA28 stack 0x6109ED48 routine 0x6045B540 count
0xA4A11
size 0x2328 low 0x2328 desc 0x60C064B4

6109EBD0: 1 6104F574 6045B6C8 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109EBF0: 61050000 6104C1F0 80007D88 60BF0000 60BF0000 60BF0000 61050000
60E84210
6109EC10: FFFFFFFF FFFFFFFF 0 61050000 0 0 0
61050000
6109EC30: 0 0 0 1FD0710 0 0 0
0
6109EC50: 0 0 0 0 0 1 FFFFFFFF
FFFF00FF
6109EC70: 0 6041CC70 FD066C4A C3F4F0C3 AC1F0010 190497 B0D6C77
A34B421C
6109EC90: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109ECB0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109ECD0: 0 6041AB28 0 0 0 3040F001 0
30410000
6109ECF0: FFFFFFFF FFFFFFFF FFFFFFFF 80007D78 FFFFFFFF FFFFFFFF 0
604234A4
6109ED10: 3400FF03 FFFFFFFF FFFFFFFF E4A2F906 FFFFFFFF FCD420E2 FFFFFFFF
FFFFFFFF
6109ED30: FFFFFFFF FFFFFFFF 0 604234B4 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
$0 : FFFFFFFF, AT : 61050000, v0 : 00000000, v1 : 61050000
a0 : 00000000, a1 : 01FD0710, a2 : 00000000, a3 : 00000000
t0 : 00000000, t1 : 00000000, t2 : 00000001, t3 : FFFF00FF
t4 : 6041CC70, t5 : C3F4F0C3, t6 : 00190497, t7 : A34B421C
s0 : FFFFFFFF, s1 : FFFFFFFF, s2 : FFFFFFFF, s3 : FFFFFFFF
s4 : FFFFFFFF, s5 : FFFFFFFF, s6 : FFFFFFFF, s7 : FFFFFFFF
t8 : 6041AB28, t9 : 00000000, k0 : 3040F001, k1 : 30410000
gp : FFFFFFFF, sp : 80007D78, s8 : FFFFFFFF, ra : 604234A4
EPC : 604234B4, ErrorEPC : FFFFFFFF, SREG : 3400FF03

---- Level 3 Interrupt stack (0x214 bytes used, out of 0x2328 available)
----

intstacks[3]: base 0x6118C9E4 stack 0x6118ED08 routine 0x6045A7E4 count
0x8244
size 0x2328 low 0x2328 desc 0x60C03F24

6118EAF8: 60BF0000 610BB4C0 603AEB30 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6118EB18: 6014FECC FFFFFFFF 6014FECC FFFFFFFF FFFFFFFF 6014FECC 610BAEA4
6126E628
6118EB38: 18 603B3714 6104F590 611B6778 2010100 3C12EFE4 6126E628
611B6778
6118EB58: 2010100 3C12EFE4 6014FF18 6014FED4 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6118EB78: 82FFFFFF FFFFFFFF 6104F590 1 6104EF80 60BF0000 60BF0000
60BF0000
6118EB98: 61050000 60BF0000 61050000 6045A8AC 611AE6C8 FFFFFFFF FFFFFFFF
FFFFFFFF
6118EBB8: 100FFFF FFFFFFFF 6146CC90 6104C1B0 80007D88 60E843A8 FFFFFFFF
FFFFFFFF
6118EBD8: 0 61050000 0 0 FFFFFFFF FFFF0000 0
61045D80
6118EBF8: 0 1FD0440 0 0 0 0 0
0
6118EC18: 0 0 0 1 FFFFFFFF FFFF00FF 0
6041CC70
6118EC38: 0 FFFF 0 FEFF 0 7C69A8A FFFFFFFF
FFFFFFFF
6118EC58: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6118EC78: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 0
612EEC94
6118EC98: 0 0 0 3040F001 0 30410000 FFFFFFFF
FFFFFFFF
6118ECB8: FFFFFFFF 80007D78 FFFFFFFF FFFFFFFF 0 604234DC 3400FF03
FFFFFFFF
6118ECD8: FFFFFFFF A3BEED91 FFFFFFFF D00D9C6B FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6118ECF8: 0 604218E8 FFFFFFFF FFFFFFFF FFFFFFFF
$0 : FFFFFFFF, AT : 61050000, v0 : 00000000, v1 : FFFF0000
a0 : 61045D80, a1 : 01FD0440, a2 : 00000000, a3 : 00000000
t0 : 00000000, t1 : 00000000, t2 : 00000001, t3 : FFFF00FF
t4 : 6041CC70, t5 : 0000FFFF, t6 : 0000FEFF, t7 : 07C69A8A
s0 : FFFFFFFF, s1 : FFFFFFFF, s2 : FFFFFFFF, s3 : FFFFFFFF
s4 : FFFFFFFF, s5 : FFFFFFFF, s6 : FFFFFFFF, s7 : FFFFFFFF
t8 : 612EEC94, t9 : 00000000, k0 : 3040F001, k1 : 30410000
gp : FFFFFFFF, sp : 80007D78, s8 : FFFFFFFF, ra : 604234DC
EPC : 604218E8, ErrorEPC : FFFFFFFF, SREG : 3400FF03

---- Level 4 Interrupt stack (0x178 bytes used, out of 0x2328 available)
----

intstacks[4]: base 0x610A0B60 stack 0x610A2E80 routine 0x60460828 count 0x4
size 0x2328 low 0x2328 desc 0x60C06FCC

610A2D10: 1E840040 604608E0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 61045DC0
3F51B9C1
610A2D30: 6104B3C8 60BC0000 10000 610B31B0 60E84540 FFFFFFFF FFFFFFFF
FFFFFFFF
610A2D50: 0 60EE0000 0 281 0 C 0
2D
610A2D70: 0 610B31B0 0 0 0 22 0
20
610A2D90: 0 0 0 53 0 61 0
1
610A2DB0: 0 3F51B9C1 0 3A 0 610B31B0 FFFFFFFF
FFFFFFFF
610A2DD0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
610A2DF0: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 0
5
610A2E10: 0 1 0 3040F001 0 30410000 FFFFFFFF
FFFFFFFF
610A2E30: 0 610B3108 FFFFFFFF FFFFFFFF 0 604075F0 3400FF03
FFFFFFFF
610A2E50: 0 3F51B9BA 0 0 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
610A2E70: 0 6041D9B0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
$0 : FFFFFFFF, AT : 60EE0000, v0 : 00000281, v1 : 0000000C
a0 : 0000002D, a1 : 610B31B0, a2 : 00000000, a3 : 00000022
t0 : 00000020, t1 : 00000000, t2 : 00000053, t3 : 00000061
t4 : 00000001, t5 : 3F51B9C1, t6 : 0000003A, t7 : 610B31B0
s0 : FFFFFFFF, s1 : FFFFFFFF, s2 : FFFFFFFF, s3 : FFFFFFFF
s4 : FFFFFFFF, s5 : FFFFFFFF, s6 : FFFFFFFF, s7 : FFFFFFFF
t8 : 00000005, t9 : 00000001, k0 : 3040F001, k1 : 30410000
gp : FFFFFFFF, sp : 610B3108, s8 : FFFFFFFF, ra : 604075F0
EPC : 6041D9B0, ErrorEPC : FFFFFFFF, SREG : 3400FF03

---- Level 5 Interrupt stack (0x0 bytes used, out of 0x2328 available) ----

intstacks[5]: base 0x6109A67C stack 0x6109C9A0 routine 0x6045337C count 0x0
size 0x2328 low 0x2328 desc 0x60C02030


---- Level 6 Interrupt stack (base 0x0, size 0x0) is invalid ----

---- Level 7 Interrupt stack (0x190 bytes used, out of 0x2328 available)
----

intstacks[7]: base 0x610982D0 stack 0x6109A5F0 routine 0x6041C924 count
0x7F438D
size 0x2328 low 0x2328 desc 0x60BF5950

6109A468: 0 1FD0710 0 1FD09B8 0 1FD09BC FFFFFFFF
FFFFFFFF
6109A488: 1E840000 30 1E840000 6041CAC0 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109A4A8: 6041BD4C 38 60363248 FFFFFFFF FFFFFFFF FFFFFFFF 0
A
6109A4C8: 0 1 0 6119A7E8 0 61020000 0
1
6109A4E8: 0 61020000 0 60E70000 0 8 0
1
6109A508: 0 0 FFFFFFFF FFFF00FF 0 6041CC70 0
0
6109A528: 0 10000000 0 0 FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109A548: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
FFFFFFFF
6109A568: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 0 0 0
1
6109A588: 0 6104AF60 0 0 FFFFFFFF FFFFFFFF 0
60E82F30
6109A5A8: FFFFFFFF FFFFFFFF 0 60363290 34018003 FFFFFFFF 0
0
6109A5C8: 0 6 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF 0
60361824
6109A5E8: FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF
$0 : FFFFFFFF, AT : 60EE0000, v0 : 0000000A, v1 : 00000000
a0 : 60E83020, a1 : FFFFFFFD, a2 : 30000000, a3 : 60E70000
t0 : 00000008, t1 : 00000001, t2 : 00000000, t3 : FFFF00FF
t4 : 6041CC70, t5 : 00000000, t6 : 10000000, t7 : 00000000
s0 : FFFFFFFF, s1 : FFFFFFFF, s2 : FFFFFFFF, s3 : FFFFFFFF
s4 : FFFFFFFF, s5 : FFFFFFFF, s6 : FFFFFFFF, s7 : FFFFFFFF
t8 : 00000000, t9 : 00000001, k0 : 6104AF60, k1 : 00000000
gp : FFFFFFFF, sp : 60E82F38, s8 : FFFFFFFF, ra : 6036370C
EPC : 60361E0C, ErrorEPC : FFFFFFFF, SREG : 34018003

========= Register Memory Dump ================

Reg00($0): 0 [Not RAM Addr]
Reg01(AT): 0 [Not RAM Addr]
Reg02(v0): 6160C220 [In malloc Block 0x6160A1DC] [Last malloc Block
0x616092B0]
Reg03(v1): 60EA899C
Reg04(a0): 6160D27E
Reg05(a1): BAE40000 [Not RAM Addr]
Reg06(a2): F8465700 [Not RAM Addr]
Reg07(a3): 6162391E [In malloc Block 0x616237C0] [Last malloc Block
0x61622894]
Reg08(t0): 21BEDE00 [Not RAM Addr]
Reg09(t1): 9 [Not RAM Addr]
Reg10(t2): CB [Not RAM Addr]
Reg11(t3): FFFF00FF [Not RAM Addr]
Reg12(t4): AD [Not RAM Addr]
Reg13(t5): C [Not RAM Addr]
Reg14(t6): 7C7337A [In malloc Block 0x7C731D8] [Last malloc Block
0x7C72AF8]
Reg15(t7): 6160A337
Reg16(s0): 6160A214
Reg17(s1): 61208E80
Reg18(s2): 616237EC
Reg19(s3): 61208ED0
Reg20(s4): 61208ED4
Reg21(s5): 61208EDC
Reg22(s6): 5 [Not RAM Addr]
Reg23(s7): 6160A214
Reg24(t8): 7C73833
Reg25(t9): 40 [Not RAM Addr]
Reg26(k0): 3040F001 [Not RAM Addr]
Reg27(k1): 30410000 [Not RAM Addr]
Reg28(gp): 60EEC4C0
Reg29(sp): 61208E50
Reg30(s8): 61208F28
Reg31(ra): 6064BEA0

buffer check=0 sched_hc=0x0

---- block0 ptr=61208DF0 is_malloc=0 length=0x260 ----


Dennis Peng wrote:
> Do you have console logs from when the parity error occurred? Without
> this or the crashinfo (which I don't think is supported on the 3640 in
> 12.2 mainline), it would be hard to say.
>
> Dennis
>
> Ahmad Cheikh Moussa [acm@netuse.de] wrote:
>
>>Hi!
>>
>>I have a memory Problem with my Cisco 3640.
>>There are 4 x 32 MB RAM inside.
>>
>>How can I find out, which module is faulty ?
>>Here an output from show version and show memory.
>>
>>Cisco Internetwork Operating System Software
>>IOS (tm) 3600 Software (C3640-I-M), Version 12.2(19), RELEASE SOFTWARE (fc3)
>>Copyright (c) 1986-2003 by cisco Systems, Inc.
>>Compiled Tue 12-Aug-03 19:39 by kellmill
>>Image text-base: 0x60008930, data-base: 0x60A38000
>>
>>ROM: System Bootstrap, Version 11.1(19)AA, EARLY DEPLOYMENT RELEASE
>>SOFTWARE (fc1)
>>
>>***** uptime is 18 hours, 26 minutes
>>System returned to ROM by processor memory parity error at PC
>>0x6064B26C, address 0x0 at 20:19:49 MEST Sun Aug 31 2003
>>System restarted at 20:20:42 MEST Sun Aug 31 2003
>>System image file is "flash:c3640-i-mz.122-19"
>>
>>cisco 3640 (R4700) processor (revision 0x00) with 125952K/5120K bytes of
>>memory.
>>Processor board ID 10131087
>>R4700 CPU at 100Mhz, Implementation 33, Rev 1.0
>>Channelized E1, Version 1.0.
>>MICA-6DM Firmware: CP ver 2940 - 7/24/2002, SP ver 2940 - 7/24/2002.
>>Bridging software.
>>X.25 software, Version 3.0.0.
>>Primary Rate ISDN software, Version 1.1.
>>1 FastEthernet/IEEE 802.3 interface(s)
>>31 Serial network interface(s)
>>12 terminal line(s)
>>1 Channelized E1/PRI port(s)
>>DRAM configuration is 64 bits wide with parity enabled.
>>125K bytes of non-volatile configuration memory.
>>24576K bytes of processor board System flash (Read/Write)
>>
>>Configuration register is 0x2102
>>
>>
>>router#sh mem
>>router#sh memory
>> Head Total(b) Used(b) Free(b) Lowest(b)
>>Largest(b)
>>Processor 61091AA0 111600992 5852760 105748232 105459380
>>105714716
>> I/O 7B00000 5243080 2692572 2550508 2550508
>> 2494684
>>
>>
>>
>>
>> Processor memory
>>
>> Address Bytes Prev Next Ref PrevF NextF Alloc PC what
>>61091AA0 0000020000 00000000 610968EC 001 -------- -------- 603F6210
>>Managed Chunk Queue Elements
>>610968EC 0000001500 61091AA0 61096EF4 001 -------- -------- 60405658
>>List Elements
>>61096EF4 0000005000 610968EC 610982A8 001 -------- -------- 60405698
>>List Headers
>>610982A8 0000009000 61096EF4 6109A5FC 001 -------- -------- 604242DC
>>Interrupt Stack
>>
>>
>>
>>
>>Thanks for any hints,
>> Ahmad Cheikh-Moussa
>>--
>>Ahmad Cheikh-Moussa
>>NetUSE AG
>>Dr.-Hell-Stra?e, 24107 Kiel, Federal Republic of Germany
>>Telefon: +49 431 386435 00 -- Telefax: +49 431 386435 99
>>Service: Service@NetUSE.DE -- http://NetUSE.DE/
>>
>>_______________________________________________
>>cisco-nas mailing list
>>cisco-nas@puck.nether.net
>>https://puck.nether.net/mailman/listinfo/cisco-nas
>


--
Ahmad Cheikh-Moussa
NetUSE AG
Dr.-Hell-Stra?e, 24107 Kiel, Federal Republic of Germany
Telefon: +49 431 386435 00 -- Telefax: +49 431 386435 99
Service: Service@NetUSE.DE -- http://NetUSE.DE/

©2024 GT.net. A Gossamer Threads company.
5th Floor, 455 Granville St., Vancouver, BC V6C 1T1, Canada | Legal