3516cv610分析ddr运行内存问题,记录
3516cv610分析ddr运行内存问题,记录情况1分析:chatgpt回答。
3516cv610分析ddr运行内存问题,记录
情况1
现象:
_recv_Proto_00 invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
CPU: 0 PID: 1426 Comm: _recv_Proto_00 Tainted: P O 5.10.221 #1
Hardware name: HI35XX
Function entered at [<c010952d>] from [<c010778b>] Function entered at [<c010778b>] from [<c04201a3>]
Function entered at [<c04201a3>] from [<c041e88b>]
Function entered at [<c041e88b>] from [<c0179b7f>] Function entered at [<c0179b7f>] from [<c017a1cb>]
Function entered at [<c017a1cb>] from [<c0198817>] Function entered at
[<c0198817>] from [<c0178601>]
Function entered at [<c0178601>] from [<c01787e1>]
Function entered at [<c01787e1>] from [<c018ba25>] Function entered at [<c018ba25>] from
[<c018d691>]
Function entered at [<c018d691>] from [<c0109e25>] Function entered at
[<c0109e25>] from [<c0109ffb>] Function entered at [<c0109ffb>] from [<c010112f>]
Exception stack(0xc2373fb0 to 0xc2373ff8) 3fa0: 00000000 a4413c90 00000000 00000004 3fc0:
00000000 00000000 00000000 00000000 a4413cd8 00000000 a4413c90 00989680 3fe0: a4413c58
a4413c80 b6eeefc9 b6ee1126 00000030 ffffffff Mem-Info: active_anon:3 inactive_anon:2567
isolated_anon:0 active_file:0 inactive_file:180 isolated_file:0 unevictable:0 dirty:0
writeback:115 slab_reclaimable:198 slab_unreclaimable:2589 mapped:8 shmem:0 pagetables:79
bounce:0 free:539 free_pcp:0 free_cma:0 Node 0 active_anon:12kB inactive_anon:10268kB
active_file:96kB inactive_file:716kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB mapped:12kB dirty:0kB writeback:460kB shmem:0kB writeback_tmp:0kB
kernel_stack:1008kB all_unreclaimable? no Normal free:2024kB min:1024kB low:1280kB
high:1536kB reserved_highatomic:0KB active_anon:12kB inactive_anon:10268kB
active_file:184kB inactive_file:824kB unevictable:0kB writepending:100kB present:40960kB
managed:34932kB mlocked:0kB pagetables:316kB bounce:0kB free_pcp:20kB local_pcp:0kB
free_cma:0kB lowmem_reserve[]: 0 0 Normal: 14*4kB (UM) 54*8kB (UM) 27*16kB (UM) 10*32kB
(UM) 6*64kB (U) 1*128kB (M) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1752kB 310
total pagecache pages 10240 pages RAM 0 pages HighMem/MovableOnly 1507 pages reserved Tasks state (memory values in pages): [ pid ] uid tgid total_vm rss pgtables_bytes swapents
oom_score_adj name [ 671] 0 671 210 27 6144 0 -1000 udevd [ 822] 0 822 342 10 6144 0 0
telnetd [ 1370] 0 1370 649 61 8192 0 0 wpa_supplicant [ 1378] 0 1378 346 15 6144 0 0 sh [
1382] 0 1382 98011 2407 129024 0 0 tg_kol_net_LP oom-
kill:constraint=CONSTRAINT_NONE,nodemask=(null),task=tg_kol_net_LP,pid=1382,uid=0
Out of memory: Killed process 1382 (tg_kol_net_LP) total-vm:392044kB, anon-rss:9628kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:126kB oom_score_adj:0
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x43749000, 32768 bytes,
'aenc(0)_strm' mmb<0x43749000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x43751000, 16384 bytes,
'aenc(0)_cir' mmb<0x43751000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x43755000, 32768 bytes,
'aenc(1)_strm' mmb<0x43755000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x4375D000, 16384 bytes,
'aenc(1)_cir' mmb<0x4375d000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x43767000, 8192 bytes,
'ao(0,0)_cir' mmb<0x43767000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x43769000, 8192 bytes,
'ao(0,1)_cir' mmb<0x43769000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release: MMB LEAK(pid=1385): 0x4376B000, 8192 bytes,
'ao(0,2)_cir' mmb<0x4376b000> mapped to userspace 0x00000000 will be unmaped! Killed
/mnt/nfs_4/sdk_V020_20s/AOV #
分析:
chatgpt回答
你贴的内核日志已经很清楚了,我帮你梳理一下:
关键现象
1、内核 OOM Killer 启动
_recv_Proto_00 invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0
...
Out of memory: Killed process 1382 (tg_kol_net_LP) total-vm:392044kB, anon-rss:9628kB
说明系统内存不足,Linux 内核的 OOM Killer(Out Of Memory Killer)选中了你的进程 tg_kol_net_LP
并杀掉了它。
2、系统内存情况
10240 pages RAM => 10240 * 4KB = 40MB RAM
free: 539 pages => ~ 2MB 可用内存
Normal free: 2024kB
👉 板子总共只有 40MB 内存,剩余可用内存只有 2MB,严重不足。
3、内存泄漏迹象 (MMZ)
MMB LEAK(pid=1385): 0x43749000, 32768 bytes, 'aenc(0)_strm'
MMB LEAK(pid=1385): 0x43751000, 16384 bytes, 'aenc(0)_cir'
MMB LEAK(pid=1385): 0x43755000, 32768 bytes, 'aenc(1)_strm'
...
这些是 3516cv410的MMZ(多媒体内存管理区) 的日志,提示有 buffer 没有正常释放。
-
aenc
→ 音频编码 buffer -
ao
→ audio output buffer
说明音视频模块退出时,申请的 MMZ 没有释放,这会进一步加剧内存紧张。
情况2:
现象
ISP1_RUN invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
CPU: 0 PID: 1391 Comm: ISP1_RUN Tainted: P O 5.10.221 #1
Hardware name: HI35XX
Function entered at [<c010952d>] from [<c010778b>]
Function entered at [<c010778b>] from [<c04201a3>]
Function entered at [<c04201a3>] from [<c041e88b>]
Function entered at [<c041e88b>] from [<c0179b7f>]
Function entered at [<c0179b7f>] from [<c017a1cb>]
Function entered at [<c017a1cb>] from [<c0198817>]
Function entered at [<c0198817>] from [<c0178601>]
Function entered at [<c0178601>] from [<c01787e1>]
Function entered at [<c01787e1>] from [<c018ba25>]
Function entered at [<c018ba25>] from [<c018d691>]
Function entered at [<c018d691>] from [<c0109e25>]
Function entered at [<c0109e25>] from [<c0109ffb>]
Function entered at [<c0109ffb>] from [<c010112f>]
Exception stack(0xc227dfb0 to 0xc227dff8)
dfa0: 00000000 c0147001 afe41c70 afe41c70
dfc0: b6fd1f58 003465f8 003465f8 00000036 00000027 c0147001 0016226e 00143add
dfe0: 001890f4 afe41b30 000c1e43 b6f9278a 20000030 ffffffff
Mem-Info:
active_anon:4 inactive_anon:2595 isolated_anon:0
active_file:112 inactive_file:239 isolated_file:32
unevictable:0 dirty:0 writeback:253
slab_reclaimable:207 slab_unreclaimable:2612
mapped:0 shmem:0 pagetables:78 bounce:0
free:1270 free_pcp:9 free_cma:0
Node 0 active_anon:16kB inactive_anon:10380kB active_file:684kB inactive_file:836kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:20kB dirty:0kB writeback:1012kB shmem:0kB writeback_tmp:0kB kernel_stack:952kB all_unreclaimable? no
Normal free:5068kB min:1024kB low:1280kB high:1536kB reserved_highatomic:0KB active_anon:16kB inactive_anon:10380kB active_file:560kB inactive_file:840kB unevictable:0kB writepending:480kB present:45056kB managed:38996kB mlocked:0kB pagetables:312kB bounce:0kB free_pcp:36kB local_pcp:16kB free_cma:0kB
lowmem_reserve[]: 0 0
Normal: 105*4kB (UM) 117*8kB (UM) 16*16kB (UM) 21*32kB (UM) 6*64kB (UM) 4*128kB (UM) 2*256kB (UM) 1*512kB (U) 1*1024kB (U) 0*2048kB 0*4096kB = 5228kB
383 total pagecache pages
11264 pages RAM
0 pages HighMem/MovableOnly
1515 pages reserved
Tasks state (memory values in pages):
[ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 670] 0 670 208 24 6144 0 -1000 udevd
[ 819] 0 819 342 10 6144 0 0 telnetd
[ 1356] 0 1356 645 60 8192 0 0 wpa_supplicant
[ 1364] 0 1364 346 15 6144 0 0 sh
[ 1373] 0 1373 97873 2439 126976 0 0 tg_kol_net_LP
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),task=tg_kol_net_LP,pid=1373,uid=0
Out of memory: Killed process 1373 (tg_kol_net_LP) total-vm:391492kB, anon-rss:9756kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:124kB oom_score_adj:0
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x43749000, 32768 bytes, 'aenc(0)_strm'
mmb<0x43749000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x43751000, 16384 bytes, 'aenc(0)_cir'
mmb<0x43751000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x43755000, 32768 bytes, 'aenc(1)_strm'
mmb<0x43755000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x4375D000, 16384 bytes, 'aenc(1)_cir'
mmb<0x4375d000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x43767000, 8192 bytes, 'ao(0,0)_cir'
mmb<0x43767000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x43769000, 8192 bytes, 'ao(0,1)_cir'
mmb<0x43769000> mapped to userspace 0x00000000 will be unmaped!
mmz_userdev:mmz_userdev_release:
MMB LEAK(pid=1376): 0x4376B000, 8192 bytes, 'ao(0,2)_cir'
mmb<0x4376b000> mapped to userspace 0x00000000 will be unmaped!
Killed
/mnt/nfs_4/sdk_V020_20s/AOV #
chatgpt分析
从你贴的 内核日志 (kernel log) 来看,ISP1_RUN
进程被 OOM killer (Out Of Memory Killer) 杀死了,原因是内存不足。我们来逐步分析:
1. 关键日志
ISP1_RUN invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE)
Out of memory: Killed process 1373 (tg_kol_net_LP) total-vm:391492kB, anon-rss:9756kB ...
说明:
-
触发 OOM killer:内存申请失败(系统内存不足,无法满足
GFP_HIGHUSER_MOVABLE
的分配请求)。 -
被杀的进程:
tg_kol_net_LP
,而不是ISP1_RUN
本身。内核选择了一个高内存占用/权重的进程杀掉。
2. 系统内存状态
Normal free:5068kB min:1024kB low:1280kB high:1536kB
present:45056kB managed:38996kB
说明:
-
总物理内存大约 45MB(非常小)-----45056KByte=44MB
-
剩余可用内存只有 5MB 左右,并且很多内存碎片化(分布在 4k、8k 小块)。
38996KByte = 38.082MB, 44-38.082 = 5.9MB
3. 进程占用
tg_kol_net_LP total-vm:391492kB, rss:9756kB, pgtables:124kB
说明:
-
tg_kol_net_LP
虚拟内存映射接近 400MB,实际物理使用约 10MB。 -
由于设备内存总量只有 45MB 左右,这种分配很容易触发 OOM。
更多推荐
所有评论(0)