Mobile QR Code QR CODE : Journal of the Korean Society of Civil Engineers

  1. ์ •ํšŒ์› ยท ๊ต์‹ ์ €์ž ยท ๋ถ€์ฒœ๋Œ€ํ•™๊ต ํ† ๋ชฉ๊ณตํ•™๊ณผ ๊ต์ˆ˜ (Bucheon University)



์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ, ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• , Three-Multihead, ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ, ๋ฐ•๋ฝ
Reinforced concrete structures, Multi-damage segmentation, Three-Multihead, Crack, Rebar exposure, Spalling

1. Introduction

์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์€ ๊ฑด์ถ•๋ฌผ, ๊ต๋Ÿ‰, ํ„ฐ๋„ ๋ฐ ์˜น๋ฒฝ ๋“ฑ ๋‹ค์–‘ํ•œ ์‚ฌํšŒ๊ธฐ๋ฐ˜์‹œ์„ค์— ๋„๋ฆฌ ์‚ฌ์šฉ๋˜๊ณ  ์žˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ์žฅ๊ธฐ๊ฐ„ ์‚ฌ์šฉ ๊ณผ์ •์—์„œ ํ™˜๊ฒฝ์  ์—ดํ™”, ๋ฐ˜๋ณตํ•˜์ค‘, ์ฒ ๊ทผ ๋ถ€์‹ ๋ฐ ๋…ธํ›„ํ™” ๋“ฑ์˜ ์˜ํ–ฅ์œผ๋กœ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ๊ณผ ๊ฐ™์€ ๋‹ค์–‘ํ•œ ์†์ƒ์ด ๋ฐœ์ƒํ•œ๋‹ค. ์ด๋Ÿฌํ•œ ์†์ƒ์€ ๊ตฌ์กฐ๋ฌผ์˜ ๋‚ด๊ตฌ์„ฑ ๋ฐ ์‚ฌ์šฉ์„ฑ์„ ์ €ํ•˜์‹œํ‚ฌ ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ์žฅ๊ธฐ์ ์œผ๋กœ ๊ตฌ์กฐ ์•ˆ์ „์„ฑ์—๋„ ์˜ํ–ฅ์„ ๋ฏธ์น  ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ ์ •ํ™•ํ•œ ์†์ƒ ์ง„๋‹จ๊ณผ ์œ ์ง€๊ด€๋ฆฌ๊ฐ€ ์ค‘์š”ํ•˜๋‹ค(Cha et al., 2017; Dorafshan et al., 2018).

์ตœ๊ทผ์—๋Š” ๋ฌด์ธํ•ญ๊ณต๊ธฐ(UAV), ๋กœ๋ด‡ ํ”Œ๋žซํผ ๋ฐ ๊ณ ํ•ด์ƒ๋„ ์˜์ƒ์žฅ๋น„์˜ ๋ฐœ์ „๊ณผ ํ•จ๊ป˜ ์˜์ƒ ๊ธฐ๋ฐ˜ ์ž๋™ ์†์ƒ์ง„๋‹จ ๊ธฐ์ˆ ์ด ํ™œ๋ฐœํžˆ ์—ฐ๊ตฌ๋˜๊ณ  ์žˆ๋‹ค. ํŠนํžˆ ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ๋ฐ˜ ์˜์ƒ๋ถ„์„ ๊ธฐ์ˆ ์€ ๊ตฌ์กฐ๋ฌผ ํ‘œ๋ฉด ์†์ƒ์„ ์ž๋™์œผ๋กœ ํƒ์ง€ํ•˜๊ณ  ์ •๋Ÿ‰ํ™”ํ•  ์ˆ˜ ์žˆ๋Š” ํšจ๊ณผ์ ์ธ ๋ฐฉ๋ฒ•์œผ๋กœ ์ฃผ๋ชฉ๋ฐ›๊ณ  ์žˆ๋‹ค(Cha et al., 2017; Dorafshan et al., 2018; Zhang et al., 2016; Zou et al., 2019). ์ดˆ๊ธฐ ์—ฐ๊ตฌ๋“ค์€ ์†์ƒ์˜ ์กด์žฌ ์—ฌ๋ถ€๋ฅผ ํŒ๋‹จํ•˜๋Š” ์˜์ƒ ๋ถ„๋ฅ˜ ๋˜๋Š” ๊ฐ์ฒด ๊ฒ€์ถœ์— ์ดˆ์ ์„ ๋‘์—ˆ์œผ๋‚˜, ์ตœ๊ทผ์—๋Š” ํ”ฝ์…€ ๋‹จ์œ„์˜ ์†์ƒ ์˜์—ญ์„ ์ถ”์ •ํ•  ์ˆ˜ ์žˆ๋Š” ์˜๋ฏธ๋ก ์  ๋ถ„ํ•  ๊ธฐ๋ฒ•์ด ๋„๋ฆฌ ํ™œ์šฉ๋˜๊ณ  ์žˆ๋‹ค(Chen et al., 2018; Ronneberger et al., 2015; Yang et al., 2018). ์˜๋ฏธ๋ก ์  ๋ถ„ํ• ์€ ์†์ƒ์˜ ์œ„์น˜์™€ ํ˜•์ƒ์„ ์ •๋ฐ€ํ•˜๊ฒŒ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์–ด ๊ตฌ์กฐ๋ฌผ ์ƒํƒœํ‰๊ฐ€ ๋ฐ ์œ ์ง€๊ด€๋ฆฌ ๋ถ„์•ผ์—์„œ ๋†’์€ ํ™œ์šฉ ๊ฐ€๋Šฅ์„ฑ์„ ๊ฐ€์ง„๋‹ค.

ํ•œํŽธ ๊ธฐ์กด ์—ฐ๊ตฌ์˜ ๋Œ€๋ถ€๋ถ„์€ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋˜๋Š” ๋ฐ•๋ฝ๊ณผ ๊ฐ™์€ ๋‹จ์ผ ์†์ƒ ์œ ํ˜•์— ๋Œ€ํ•œ ๋ถ„ํ•  ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ์ง‘์ค‘๋˜์–ด ์žˆ๋‹ค. ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ์—์„œ๋Š” ์—ฌ๋Ÿฌ ์†์ƒ์ด ๋ณตํ•ฉ์ ์œผ๋กœ ๊ณต์กดํ•˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์œผ๋ฉฐ, ์ฒ ๊ทผ ๋ถ€์‹์— ์˜ํ•ด ๊ท ์—ด์ด ๋ฐœ์ƒํ•˜๊ณ , ์ดํ›„ ๋ฐ•๋ฝ ๋ฐ ์ฒ ๊ทผ๋…ธ์ถœ๋กœ ์ง„ํ–‰๋˜๋Š” ์—ดํ™” ๊ณผ์ •์ด ๋Œ€ํ‘œ์ ์ธ ์˜ˆ์ด๋‹ค. ๋”ฐ๋ผ์„œ ์‹ค์ œ ์ ๊ฒ€ ํ™˜๊ฒฝ์—์„œ๋Š” ์—ฌ๋Ÿฌ ์†์ƒ ์œ ํ˜•์„ ๋™์‹œ์— ๊ณ ๋ คํ•  ์ˆ˜ ์žˆ๋Š” ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ๊ธฐ์ˆ ์ด ์š”๊ตฌ๋œ๋‹ค.

๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ• ์„ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ ์ ๊ฒ€ ํ™˜๊ฒฝ์— ์ ์šฉํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ๋ช‡ ๊ฐ€์ง€ ๊ธฐ์ˆ ์  ๊ณผ์ œ๋ฅผ ํ•ด๊ฒฐํ•  ํ•„์š”๊ฐ€ ์žˆ๋‹ค. ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์€ ํ˜•์ƒ์  ํŠน์„ฑ์ด ํฌ๊ฒŒ ์ƒ์ดํ•˜์—ฌ ๋‹จ์ผ ์ถœ๋ ฅ ๊ตฌ์กฐ๋งŒ์œผ๋กœ๋Š” ๊ฐ ์†์ƒ์˜ ํŠน์ง•์„ ํšจ๊ณผ์ ์œผ๋กœ ํ•™์Šตํ•˜๊ธฐ ์–ด๋ ต๋‹ค. ๋˜ํ•œ ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค๋Š” ๋™์ผ ์˜์—ญ ๋˜๋Š” ์ธ์ ‘ ์˜์—ญ์— ํ•จ๊ป˜ ์กด์žฌํ•  ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ, ์‹ค์ œ ์†์ƒ๊ณผ ๋ฌด๊ด€ํ•œ ํด๋ž˜์Šค๊ฐ€ ๋™์‹œ์— ํ™œ์„ฑํ™”๋˜๊ฑฐ๋‚˜ ์ค‘๋ณต ์˜ˆ์ธก์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค.

๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์„ ๋™์‹œ์— ๋ถ„ํ• ํ•˜๊ธฐ ์œ„ํ•œ Three-Multihead ๊ธฐ๋ฐ˜ ์˜๋ฏธ๋ก ์  ๋ถ„ํ•  ๋ชจ๋ธ์„ ์ œ์•ˆํ•œ๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์€ ๊ณต์œ  ์ธ์ฝ”๋”์™€ ์†์ƒ๋ณ„ ์ „์šฉ ํ—ค๋“œ๋กœ ๊ตฌ์„ฑ๋˜์–ด ์†์ƒ๋ณ„ ํŠน์ง•์„ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•˜๋ฉด์„œ๋„ ํ•˜๋‚˜์˜ ์˜์ƒ์—์„œ ์—ฌ๋Ÿฌ ์†์ƒ์„ ๋™์‹œ์— ์˜ˆ์ธกํ•  ์ˆ˜ ์žˆ๋„๋ก ์„ค๊ณ„๋˜์—ˆ๋‹ค. ๋˜ํ•œ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Pairwise Prior๋ฅผ ๋„์ž…ํ•˜๊ณ , ํด๋ž˜์Šค ๊ฐ„ ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Extra Loss๋ฅผ ์ ์šฉํ•จ์œผ๋กœ์จ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ฐœ์ƒํ•˜๋Š” ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ ๋ฌธ์ œ๋ฅผ ์™„ํ™”ํ•˜๊ณ ์ž ํ•˜์˜€๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ๊ฒ€์ฆํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ๊ธฐ์ค€ ๋ชจ๋ธ ๋ฐ Multi-Damage Representation ๋ชจ๋ธ๊ณผ์˜ ๋น„๊ต ์‹คํ—˜๊ณผ Ablation Study๋ฅผ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ๋˜ํ•œ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ์—์„œ ์ˆ˜์ง‘ํ•œ 44์žฅ์˜ ๋ณตํ•ฉ ์†์ƒ ์ด๋ฏธ์ง€๋ฅผ ๋ณ„๋„๋กœ ๊ตฌ์ถ•ํ•˜์—ฌ ์„ฑ๋Šฅ์„ ํ‰๊ฐ€ํ•˜์˜€์œผ๋ฉฐ, Fine-Tuning๊ณผ Threshold Optimization์„ ์ˆ˜ํ–‰ํ•˜์—ฌ ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ์„ฑ๋Šฅ ํ–ฅ์ƒ ๊ฐ€๋Šฅ์„ฑ์„ ์ถ”๊ฐ€์ ์œผ๋กœ ๋ถ„์„ํ•˜์˜€๋‹ค.

2. Related Work

2.1 RC Damage Segmentation Studies

์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์˜ ์†์ƒ ์ž๋™ ์ธ์‹์€ ์ตœ๊ทผ ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ˆ ์˜ ๋ฐœ์ „๊ณผ ํ•จ๊ป˜ ํ™œ๋ฐœํžˆ ์—ฐ๊ตฌ๋˜๊ณ  ์žˆ๋‹ค. ์ดˆ๊ธฐ ์—ฐ๊ตฌ๋“ค์€ ์†์ƒ์˜ ์กด์žฌ ์—ฌ๋ถ€๋ฅผ ํŒ๋‹จํ•˜๋Š” ์˜์ƒ ๋ถ„๋ฅ˜ ๋˜๋Š” ๊ฐ์ฒด ๊ฒ€์ถœ์— ์ดˆ์ ์„ ๋‘์—ˆ์œผ๋‚˜, ์ตœ๊ทผ์—๋Š” ํ”ฝ์…€ ๋‹จ์œ„์˜ ์†์ƒ ์˜์—ญ์„ ์ถ”์ •ํ•  ์ˆ˜ ์žˆ๋Š” ์˜๋ฏธ๋ก ์  ๋ถ„ํ•  ๊ธฐ๋ฒ•์ด ๋„๋ฆฌ ํ™œ์šฉ๋˜๊ณ  ์žˆ๋‹ค. ๊ท ์—ด ๊ฒ€์ถœ ๋ถ„์•ผ์—์„œ๋Š” U-Net, FCN ๋ฐ DeepLab ๊ณ„์—ด ๋ชจ๋ธ์„ ํ™œ์šฉํ•œ ์—ฐ๊ตฌ๊ฐ€ ์ˆ˜ํ–‰๋˜์—ˆ์œผ๋ฉฐ, Zou et al.(2019)์€ DeepCrack์„ ์ œ์•ˆํ•˜์—ฌ ๊ณ„์ธต์  ํŠน์ง• ์ถ”์ถœ ๊ธฐ๋ฐ˜์˜ ๊ท ์—ด ๊ฒ€์ถœ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋ณด๊ณ ํ•˜์˜€๋‹ค. ๋˜ํ•œ Yang et al.(2018)์€ FCN์„ ์ด์šฉํ•œ ํ”ฝ์…€ ๋‹จ์œ„ ๊ท ์—ด ๊ฒ€์ถœ์˜ ๊ฐ€๋Šฅ์„ฑ์„ ์ œ์‹œํ•˜์˜€์œผ๋ฉฐ, Dorafshan et al.(2018)์€ CNN ๊ธฐ๋ฐ˜ ์ ‘๊ทผ๋ฒ•์˜ ์ ์šฉ ๊ฐ€๋Šฅ์„ฑ์„ ํ™•์ธํ•˜์˜€๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๋Œ€๋ถ€๋ถ„์˜ ์—ฐ๊ตฌ๋Š” ํŠน์ • ์†์ƒ ์œ ํ˜•, ํŠนํžˆ ๊ท ์—ด ๊ฒ€์ถœ์— ์ง‘์ค‘๋˜์–ด ์žˆ์œผ๋ฉฐ, ๊ท ์—ดยท์ฒ ๊ทผ๋…ธ์ถœยท๋ฐ•๋ฝ์„ ๋™์‹œ์— ๊ณ ๋ คํ•˜๋Š” ์—ฐ๊ตฌ๋Š” ์ƒ๋Œ€์ ์œผ๋กœ ๋ถ€์กฑํ•˜๋‹ค. ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์ด ๋ณตํ•ฉ์ ์œผ๋กœ ๋ฐœ์ƒํ•˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์œผ๋ฏ€๋กœ, ๋‹ค์ค‘ ์†์ƒ์„ ๋™์‹œ์— ๊ณ ๋ คํ•  ์ˆ˜ ์žˆ๋Š” ๋ถ„ํ•  ํ”„๋ ˆ์ž„์›Œํฌ๊ฐ€ ์š”๊ตฌ๋œ๋‹ค.

2.2 Multi-Damage Segmentation

๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ• ์€ ํ•˜๋‚˜์˜ ๋„คํŠธ์›Œํฌ๋ฅผ ์ด์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ์†์ƒ ์œ ํ˜•์„ ๋™์‹œ์— ์ธ์‹ํ•˜๋Š” ๋ฐฉ๋ฒ•์œผ๋กœ, ์ตœ๊ทผ ๊ตฌ์กฐ๋ฌผ ์œ ์ง€๊ด€๋ฆฌ ๋ถ„์•ผ์—์„œ ๊ด€์‹ฌ์ด ์ฆ๊ฐ€ํ•˜๊ณ  ์žˆ๋‹ค(Bai et al., 2021; Kim and Cho, 2020). ๋‹จ์ผ ์†์ƒ ๋ชจ๋ธ์„ ๊ฐ๊ฐ ๋…๋ฆฝ์ ์œผ๋กœ ์šด์˜ํ•  ๊ฒฝ์šฐ ์†์ƒ ์œ ํ˜•๋ณ„๋กœ ๋ณ„๋„์˜ ์ถ”๋ก  ๊ณผ์ •์ด ํ•„์š”ํ•˜์ง€๋งŒ, ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ• ์€ ํ•˜๋‚˜์˜ ์ถ”๋ก  ๊ณผ์ •์—์„œ ๋ณต์ˆ˜์˜ ์†์ƒ ์ •๋ณด๋ฅผ ๋™์‹œ์— ํš๋“ํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ์žฅ์ ์„ ๊ฐ€์ง„๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ๊ณผ ๊ฐ™์ด ํ˜•์ƒ ํŠน์„ฑ์ด ํฌ๊ฒŒ ๋‹ค๋ฅธ ์†์ƒ๋“ค์€ ๋™์ผํ•œ ํŠน์ง• ๊ณต๊ฐ„์—์„œ ํ•™์Šต๋  ๊ฒฝ์šฐ ํด๋ž˜์Šค ๊ฐ„ ๊ฒฝ์Ÿ๊ณผ ๊ฒฝ๊ณ„ ๊ฐ„์„ญ์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋Ÿฌํ•œ ํ˜„์ƒ์€ ๋‹ค์ค‘ ๊ณผ์ œ ํ•™์Šต์—์„œ ๋ณด๊ณ ๋˜๋Š” task interference ๋˜๋Š” negative transfer ๋ฌธ์ œ์™€ ๊ด€๋ จ๋œ๋‹ค(Ding et al., 2023; Vandenhende et al., 2020). ๋˜ํ•œ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ๊ณ ๋ คํ•˜์ง€ ์•Š๋Š” ๊ฒฝ์šฐ ์‹ค์ œ ์†์ƒ๊ณผ ๋ฌด๊ด€ํ•œ ํด๋ž˜์Šค๊ฐ€ ํ•จ๊ป˜ ํ™œ์„ฑํ™”๋˜๊ฑฐ๋‚˜ ์ค‘๋ณต ์˜ˆ์ธก์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ๋”ฐ๋ผ์„œ ๋‹ค์ค‘ ์†์ƒ ํ™˜๊ฒฝ์—์„œ๋Š” ์†์ƒ๋ณ„ ํŠน์„ฑ์„ ์œ ์ง€ํ•˜๋ฉด์„œ๋„ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•จ๊ป˜ ๊ณ ๋ คํ•  ์ˆ˜ ์žˆ๋Š” ๋ถ„ํ•  ๊ตฌ์กฐ๊ฐ€ ์š”๊ตฌ๋œ๋‹ค.

2.3 Multi-Task Learning and Multi-Head Architecture

Multi-Task Learning(MTL)์€ ํ•˜๋‚˜์˜ ๋ชจ๋ธ์ด ์—ฌ๋Ÿฌ ๊ฐœ์˜ ๊ด€๋ จ ๊ณผ์ œ๋ฅผ ๋™์‹œ์— ํ•™์Šตํ•˜๋„๋ก ์„ค๊ณ„ํ•˜๋Š” ๋ฐฉ๋ฒ•์œผ๋กœ, ์ผ๋ฐ˜์ ์œผ๋กœ ๊ณตํ†ต ํŠน์ง• ์ถ”์ถœ๊ธฐ์™€ ๊ณผ์ œ๋ณ„ ์ถœ๋ ฅ ํ—ค๋“œ๋กœ ๊ตฌ์„ฑ๋œ๋‹ค(Caruana, 1997; Crawshaw, 2020; Kendall et al., 2018). ์ตœ๊ทผ ์ปดํ“จํ„ฐ ๋น„์ „ ๋ถ„์•ผ์—์„œ๋Š” ๊ฐ์ฒด ๊ฒ€์ถœ, ์˜๋ฏธ๋ก ์  ๋ถ„ํ• , ๊นŠ์ด ์ถ”์ • ๋“ฑ ๋‹ค์–‘ํ•œ ๋ฌธ์ œ์— MTL์ด ์ ์šฉ๋˜๊ณ  ์žˆ์œผ๋ฉฐ, ๊ด€๋ จ ๊ณผ์ œ ๊ฐ„ ํŠน์ง• ์ •๋ณด๋ฅผ ๊ณต์œ ํ•จ์œผ๋กœ์จ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋‹ฌ์„ฑํ•˜๊ณ  ์žˆ๋‹ค(Crawshaw, 2020; Kendall et al., 2018). ๊ตฌ์กฐ๋ฌผ ์†์ƒ ๋ถ„ํ•  ๊ด€์ ์—์„œ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์€ ๋ชจ๋‘ ์ฝ˜ํฌ๋ฆฌํŠธ ์—ดํ™”์™€ ๊ด€๋ จ๋œ ์†์ƒ์ด์ง€๋งŒ ํ˜•์ƒ์  ํŠน์„ฑ์€ ์„œ๋กœ ๋‹ค๋ฅด๋‹ค. ๋”ฐ๋ผ์„œ ๊ณต์œ  ํŠน์ง• ๊ณต๊ฐ„์„ ํ™œ์šฉํ•˜๋ฉด์„œ๋„ ์†์ƒ๋ณ„ ํŠน์ง•์„ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•  ์ˆ˜ ์žˆ๋Š” Multi-Head ๊ตฌ์กฐ๊ฐ€ ํšจ๊ณผ์ ์ธ ๋Œ€์•ˆ์ด ๋  ์ˆ˜ ์žˆ๋‹ค. ํŠนํžˆ ๊ท ์—ด์€ ์„ ํ˜• ๊ตฌ์กฐ, ์ฒ ๊ทผ๋…ธ์ถœ์€ ๋ฐฉํ–ฅ์„ฑ๊ณผ ์งˆ๊ฐ ํŠน์„ฑ, ๋ฐ•๋ฝ์€ ๋ฉด์  ๊ธฐ๋ฐ˜ ํŠน์„ฑ์„ ๊ฐ€์ง€๋ฏ€๋กœ ๋‹จ์ผ ์ถœ๋ ฅ ๊ตฌ์กฐ๋ณด๋‹ค ์†์ƒ๋ณ„ ์ „์šฉ ํ—ค๋“œ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” Multi-Head ๊ตฌ์กฐ๊ฐ€ ๋ณด๋‹ค ํšจ๊ณผ์ ์ผ ์ˆ˜ ์žˆ๋‹ค. ์ด๋Ÿฌํ•œ ํŠน์„ฑ์„ ๊ณ ๋ คํ•˜์—ฌ ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์„ ์œ„ํ•œ Three-Multihead ๊ตฌ์กฐ๋ฅผ ์ฑ„ํƒํ•˜์˜€๋‹ค.

2.4 Knowledge Distillation and Damage-Aware Learning

Knowledge Distillation(KD)์€ ์„ฑ๋Šฅ์ด ์šฐ์ˆ˜ํ•œ Teacher ๋ชจ๋ธ์˜ ์ง€์‹์„ Student ๋ชจ๋ธ๋กœ ์ „๋‹ฌํ•˜์—ฌ ๋ณด๋‹ค ํšจ์œจ์ ์ธ ํ•™์Šต์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๋ฐฉ๋ฒ•์ด๋‹ค(Hinton et al., 2015; Romero et al., 2015). ์ผ๋ฐ˜์ ์œผ๋กœ Teacher ๋ชจ๋ธ์˜ ์˜ˆ์ธก ๊ฒฐ๊ณผ ๋˜๋Š” ํŠน์ง• ์ •๋ณด๋ฅผ Student ๋ชจ๋ธ์ด ํ•™์Šตํ•จ์œผ๋กœ์จ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ ๋„ํ•œ๋‹ค. ํ•œํŽธ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ์˜ ์†์ƒ์€ ์„œ๋กœ ๋…๋ฆฝ์ ์ด์ง€ ์•Š์œผ๋ฉฐ ์—ดํ™” ๊ณผ์ •์— ๋”ฐ๋ผ ์ผ์ •ํ•œ ๊ด€๊ณ„๋ฅผ ๊ฐ€์ง„๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด ์ฒ ๊ทผ ๋ถ€์‹์€ ๊ท ์—ด์„ ์œ ๋ฐœํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๊ท ์—ด์˜ ์ง„ํ–‰์€ ๋ฐ•๋ฝ๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ๋กœ ์ด์–ด์งˆ ์ˆ˜ ์žˆ๋‹ค. ์ด๋Ÿฌํ•œ ํŠน์„ฑ์„ ๊ณ ๋ คํ•˜์—ฌ ์†์ƒ๋ณ„ ํŠน์ง• ์ •๋ณด๋ฅผ ํšจ๊ณผ์ ์œผ๋กœ ํ™œ์šฉํ•˜๋ฉด์„œ๋„ ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๋ฐ˜์˜ํ•  ์ˆ˜ ์žˆ๋Š” ํ•™์Šต ์ „๋žต์ด ํ•„์š”ํ•˜๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์˜ ์ •๋ณด๋ฅผ ํ™œ์šฉํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Knowledge Distillation์„ ์ ์šฉํ•˜์˜€์œผ๋ฉฐ, ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๋ฐ˜์˜ํ•˜๊ธฐ ์œ„ํ•œ Pairwise Prior์™€ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•˜๊ธฐ ์œ„ํ•œ Extra Loss๋ฅผ ํ•จ๊ป˜ ์ ์šฉํ•˜์˜€๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋„๋ชจํ•˜๊ณ ์ž ํ•˜์˜€๋‹ค.

3. Proposed Three-Multihead Framework

3.1 Overview of the Proposed Framework

๋ณธ ์—ฐ๊ตฌ๋Š” ์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์—์„œ ๋ฐœ์ƒํ•˜๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์„ ๋™์‹œ์— ๋ถ„ํ• ํ•˜๊ธฐ ์œ„ํ•œ Three Multihead ๊ธฐ๋ฐ˜ ์˜๋ฏธ๋ก ์  ๋ถ„ํ•  ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ์•ˆํ•œ๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์€ ํ•˜๋‚˜์˜ ๊ณต์œ  ์ธ์ฝ”๋”์™€ ์„ธ ๊ฐœ์˜ ์†์ƒ ์ „์šฉ ํ—ค๋“œ๋กœ ๊ตฌ์„ฑ๋œ๋‹ค. ๊ณต์œ  ์ธ์ฝ”๋”๋Š” ์ž…๋ ฅ ์˜์ƒ์œผ๋กœ๋ถ€ํ„ฐ ๊ณตํ†ต ํŠน์ง•์„ ์ถ”์ถœํ•˜๋ฉฐ, ๊ฐ ์†์ƒ ์ „์šฉ ํ—ค๋“œ๋Š” ์†์ƒ ์œ ํ˜•๋ณ„ ํŠน์ง•์„ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•œ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ํ•˜๋‚˜์˜ ๋„คํŠธ์›Œํฌ์—์„œ ๋‹ค์ค‘ ์†์ƒ์„ ๋™์‹œ์— ์˜ˆ์ธกํ•˜๋ฉด์„œ๋„ ์†์ƒ๋ณ„ ํŠน์„ฑ์„ ํšจ๊ณผ์ ์œผ๋กœ ๋ฐ˜์˜ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜์˜€๋‹ค. ๋˜ํ•œ ๋‹จ์ผ ์†์ƒ ๋ชจ๋ธ๋กœ๋ถ€ํ„ฐ ํ•™์Šต๋œ ์†์ƒ๋ณ„ ํŠน์ง• ์ •๋ณด๋ฅผ ํ™œ์šฉํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Knowledge Distillation(KD)์„ ์ ์šฉํ•˜์˜€๋‹ค. ์•„์šธ๋Ÿฌ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋Š” ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ์ค‘๋ณต ํ™œ์„ฑํ™” ๋ฌธ์ œ๋ฅผ ์™„ํ™”ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Pairwise Prior์™€ Extra Loss๋ฅผ ๋„์ž…ํ•˜์˜€๋‹ค. Pairwise Prior๋Š” ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜๋ฉฐ, Extra Loss๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค์˜ ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•˜๋Š” ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•œ๋‹ค. Fig. 1์€ ์ œ์•ˆ๋œ Three-Multihead ํ”„๋ ˆ์ž„์›Œํฌ์˜ ์ „์ฒด ๊ตฌ์กฐ๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์€ Knowledge Distillation, Pairwise Prior ๋ฐ Extra Loss๋ฅผ ํ†ตํ•ฉ์ ์œผ๋กœ ํ™œ์šฉํ•˜์—ฌ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ์„ ํ™•๋ณดํ•˜๋„๋ก ์„ค๊ณ„๋˜์—ˆ๋‹ค.

Fig. 1. Overall Architecture of the Proposed Three-Multihead Framework Incorporating Knowledge Distillation, Pairwise Prior, and Extra Loss for Composite Damage Segmentation

../../Resources/KSCE/Ksce.2026.46.4.0363/fig1.png

3.2 Construction of Single-Damage Teacher Models

๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ๋ชจ๋ธ์„ ๊ตฌ์ถ•ํ•˜๊ธฐ์— ์•ž์„œ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์— ๋Œ€ํ•œ ๋‹จ์ผ ์†์ƒ ๋ถ„ํ•  ๋ชจ๋ธ์„ ๊ฐ๊ฐ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•˜์˜€๋‹ค. ๊ฐ ๋ชจ๋ธ์€ AI Hub ์‚ฌํšŒ๊ธฐ๋ฐ˜์‹œ์„ค ์†์ƒ ์˜์ƒ ๋ฐ์ดํ„ฐ์…‹(AI-Hub, 2024)์„ ํ™œ์šฉํ•˜์—ฌ ๊ตฌ์ถ•ํ•˜์˜€์œผ๋ฉฐ, ํ•ด๋‹น ์†์ƒ ์œ ํ˜•๋งŒ์„ ๋Œ€์ƒ์œผ๋กœ ํ•™์Šต์„ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ๋ฐ์ดํ„ฐ ๊ตฌ์„ฑ ๋ฐ ํ•™์Šต ์กฐ๊ฑด์€ Table 1๊ณผ ๊ฐ™๋‹ค.

Table 1. Training Dataset and Experimental Settings

Total number of images Data split ratio Input image size Data augmentation Model architecture Loss function Optimizer Number of epochs
ยทTotal 10,500
ยท3,500 for Crack
ยท3,500 for Spalling
ยท3,500 for Rebar Exposure
ยท70 % for training
ยท15 % for validation
ยท15 % for testing
512 ร— 512 pixel ยทHorizontal flip
ยทVertical flip
ยทRotation
ยทShift, scale, color jitter
DeepLabV3+ ResNet50 Cross Entropy Loss AdamW 150

๊ฐ ์†์ƒ ์œ ํ˜•๋ณ„๋กœ 3,500์žฅ์˜ ์˜์ƒ์„ ์‚ฌ์šฉํ•˜์˜€์œผ๋ฉฐ, ๋ฐ์ดํ„ฐ์…‹์€ ์ด๋ฏธ์ง€ ๋‹จ์œ„๋กœ ๋ฌด์ž‘์œ„ ๋ถ„ํ• ํ•˜์—ฌ ํ•™์Šต(70 %), ๊ฒ€์ฆ(15 %), ํ…Œ์ŠคํŠธ(15 %) ๋ฐ์ดํ„ฐ๋กœ ๊ตฌ์„ฑํ•˜์˜€๋‹ค. ์ž…๋ ฅ ์˜์ƒ ํฌ๊ธฐ๋Š” 512 ร— 512 pixel๋กœ ์„ค์ •ํ•˜์˜€์œผ๋ฉฐ, ๋ชจ๋ธ์˜ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ„ํ•˜์—ฌ horizontal flip, vertical flip, rotation, shift, scale ๋ฐ color jitter ๋“ฑ์˜ ๋ฐ์ดํ„ฐ ์ฆ๊ฐ• ๊ธฐ๋ฒ•์„ ์ ์šฉํ•˜์˜€๋‹ค. ๋ชจ๋ธ์€ DeepLabV3+ ๊ตฌ์กฐ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜๋ฉฐ ๋ฐฑ๋ณธ์œผ๋กœ ResNet50์„ ์‚ฌ์šฉํ•˜์˜€๋‹ค(Chen et al., 2018; He et al., 2016). ์†์‹ค ํ•จ์ˆ˜๋Š” Cross Entropy Loss๋ฅผ ์‚ฌ์šฉํ•˜์˜€๊ณ , learning rate=$2.4 \times 10^{-4}$, weight decay=$1 \times 10^{-4}$, batch size=2 ๋ฐ AdamW optimizer๋ฅผ ์ ์šฉํ•˜์—ฌ ์ด 150 epoch ๋™์•ˆ ํ•™์Šต์„ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ์„ฑ๋Šฅ ํ‰๊ฐ€๋Š” IoU, Dice coefficient, Precision, Recall ๋ฐ F1 score๋ฅผ ์ด์šฉํ•˜์˜€์œผ๋ฉฐ, ๊ฐ ํ‰๊ฐ€์ง€ํ‘œ๋Š” Eqs. (1)~(5)์™€ ๊ฐ™์ด ์ •์˜๋œ๋‹ค.

(1)
$Dice = \frac{2TP}{2TP + FP + FN}$
(2)
$IoU = \frac{TP}{TP + FP + FN}$
(3)
$Precision = \frac{TP}{TP + FP}$
(4)
$Recall = \frac{TP}{TP + FN}$
(5)
$F1 = \frac{2 \cdot Precision \cdot Recall}{Precision + Recall}$

Eqs. (1)~(5)์—์„œ TP, FP ๋ฐ FN์€ ๊ฐ๊ฐ ์˜ˆ์ธก ๊ฒฐ๊ณผ์™€ ์ •๋‹ต ๊ฐ„์˜ ์ผ์น˜ ๋ฐ ์˜ค์ฐจ๋ฅผ ์˜๋ฏธํ•œ๋‹ค. ๋˜ํ•œ ๊ฒฝ๊ณ„ ๊ฒ€์ถœ ์„ฑ๋Šฅ์„ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Boundary F1์„ ์ถ”๊ฐ€์ ์œผ๋กœ ์‚ฌ์šฉํ•˜์˜€๋‹ค. Boundary F1์€ ์˜ˆ์ธก ๊ฒฝ๊ณ„์™€ ์‹ค์ œ ๊ฒฝ๊ณ„ ๊ฐ„์˜ ์ผ์น˜๋„๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ์ง€ํ‘œ๋กœ, ๊ฒฝ๊ณ„ ํ”ฝ์…€ ๊ธฐ๋ฐ˜์˜ precision๊ณผ recall์„ ์ด์šฉํ•˜์—ฌ ๊ณ„์‚ฐ๋œ๋‹ค.

๊ฐ ์†์ƒ๋ณ„ Optimal Threshold๋Š” ๊ฒ€์ฆ ๋ฐ์ดํ„ฐ์…‹์— ๋Œ€ํ•ด ์ˆ˜ํ–‰ํ•œ threshold sweep ๊ฒฐ๊ณผ ์ค‘ Dice score๊ฐ€ ์ตœ๋Œ€๊ฐ€ ๋˜๋Š” ๊ฐ’์„ ์‚ฌ์šฉํ•˜์˜€๋‹ค. Table 2์— ๋”ฐ๋ฅด๋ฉด ์ฒ ๊ทผ๋…ธ์ถœ์€ Dice 0.82, mIoU 0.70์œผ๋กœ ๊ฐ€์žฅ ๋†’์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ์œผ๋ฉฐ, ๋ฐ•๋ฝ์€ Dice 0.80, ๊ท ์—ด์€ Dice 0.70์„ ๊ธฐ๋กํ•˜์˜€๋‹ค. ํŠนํžˆ ๊ท ์—ด์€ Boundary F1์ด 0.55๋กœ ๊ฐ€์žฅ ๋†’๊ฒŒ ๋‚˜ํƒ€๋‚˜ ์„ ํ˜• ๊ตฌ์กฐ์˜ ์—ฐ๊ฒฐ์„ฑ๊ณผ ๊ฒฝ๊ณ„ ๋ณด์กด ํŠน์„ฑ์ด ๋น„๊ต์  ์ž˜ ์œ ์ง€๋จ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ๋‹ค. ๋ฐ˜๋ฉด ๋ฐ•๋ฝ์€ Dice 0.80์„ ๊ธฐ๋กํ•˜์˜€์œผ๋‚˜ Boundary F1์€ 0.28๋กœ ๋‚˜ํƒ€๋‚˜ ๊ฒฝ๊ณ„ ์ •๋ฐ€๋„ ์ธก๋ฉด์—์„œ ์ƒ๋Œ€์ ์œผ๋กœ ์–ด๋ ค์›€์ด ์žˆ์Œ์„ ํ™•์ธํ•˜์˜€๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ์†์ƒ ์œ ํ˜•์— ๋”ฐ๋ผ ํ˜•์ƒ์  ํŠน์„ฑ๊ณผ ๊ฒ€์ถœ ๋‚œ์ด๋„๊ฐ€ ์ƒ์ดํ•จ์„ ๋ณด์—ฌ์ค€๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๊ฐ ๋‹จ์ผ ์†์ƒ ๋ชจ๋ธ์„ Teacher ๋ชจ๋ธ๋กœ ํ™œ์šฉํ•˜์—ฌ Knowledge Distillation์„ ์ˆ˜ํ–‰ํ•˜๊ณ , ์ด๋ฅผ ํ†ตํ•ด ํ•™์Šต๋œ ์†์ƒ๋ณ„ ํŠน์ง• ์ •๋ณด๋ฅผ Three Multihead Student ๋ชจ๋ธ์— ์ „๋‹ฌํ•˜๊ณ ์ž ํ•˜์˜€๋‹ค.

Table 2. Performance Comparison of Single-Damage Segmentation Models

Damage Type Optimal Epoch Total number of images Optimal Threshold mIoU Dice Precision Recall F1 Boundary F1
Crack 95 3,500 0.59 0.55 0.70 0.64 0.78 0.70 0.55
Rebar Exposure 111 3,500 0.86 0.70 0.82 0.76 0.90 0.82 0.48
Spalling 104 3,500 0.70 0.68 0.80 0.72 0.91 0.80 0.28

3.3 Proposed Three-Multihead Student Model

3.3.1 Multihead Architecture

๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์„ ํ•˜๋‚˜์˜ ๋„คํŠธ์›Œํฌ์—์„œ ๋™์‹œ์— ๋ถ„ํ• ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Three Multihead ๊ธฐ๋ฐ˜ Student ๋ชจ๋ธ์„ ์ œ์•ˆํ•œ๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์€ ํ•˜๋‚˜์˜ ๊ณต์œ  ์ธ์ฝ”๋”์™€ ์„ธ ๊ฐœ์˜ ์†์ƒ ์ „์šฉ ํ—ค๋“œ๋กœ ๊ตฌ์„ฑ๋œ๋‹ค. ๊ณต์œ  ์ธ์ฝ”๋”๋Š” ์ž…๋ ฅ ์˜์ƒ์œผ๋กœ๋ถ€ํ„ฐ ๊ณตํ†ต ํŠน์ง•์„ ์ถ”์ถœํ•˜๋ฉฐ, ๊ฐ ์†์ƒ ์ „์šฉ ํ—ค๋“œ๋Š” ํ•ด๋‹น ์†์ƒ์˜ ํ˜•์ƒ์  ํŠน์„ฑ์„ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•œ๋‹ค.

๊ท ์—ด์€ ์–‡๊ณ  ์—ฐ์†์ ์ธ ์„ ํ˜• ๊ตฌ์กฐ๋ฅผ ๊ฐ€์ง€๋ฉฐ, ์ฒ ๊ทผ๋…ธ์ถœ์€ ๋ฐฉํ–ฅ์„ฑ๊ณผ ์งˆ๊ฐ ํŠน์ง•์ด ๋‘๋“œ๋Ÿฌ์ง„๋‹ค. ๋ฐ˜๋ฉด ๋ฐ•๋ฝ์€ ๋น„๊ต์  ๋„“์€ ๋ฉด์  ๊ธฐ๋ฐ˜์˜ ๋ถˆ๊ทœ์น™ ํ˜•์ƒ์„ ๋‚˜ํƒ€๋‚ธ๋‹ค. ๋”ฐ๋ผ์„œ ๋‹จ์ผ ์ถœ๋ ฅ ๊ตฌ์กฐ์—์„œ๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ์˜ ํŠน์ง•์ด ๋™์ผํ•œ ํŠน์ง• ๊ณต๊ฐ„์—์„œ ๊ฒฝ์Ÿํ•˜๊ฒŒ ๋˜์ง€๋งŒ, Multihead ๊ตฌ์กฐ๋Š” ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„์„ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•  ์ˆ˜ ์žˆ์–ด ์ด๋Ÿฌํ•œ ๋ฌธ์ œ๋ฅผ ์™„ํ™”ํ•  ์ˆ˜ ์žˆ๋‹ค. ๋˜ํ•œ Knowledge Distillation์„ ์ ์šฉํ•˜์—ฌ ๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์˜ ์ •๋ณด๋ฅผ Student ๋ชจ๋ธ์— ์ „๋‹ฌํ•จ์œผ๋กœ์จ ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„์„ ์œ ์ง€ํ•˜๋ฉด์„œ ๋ณตํ•ฉ ์†์ƒ์„ ๋™์‹œ์— ์˜ˆ์ธกํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜์˜€๋‹ค.

3.3.2 Knowledge Distillation

๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์ด ํ•™์Šตํ•œ ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„ ์ •๋ณด๋ฅผ Multihead Student ๋ชจ๋ธ์— ์ „๋‹ฌํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Knowledge Distillation์„ ์ ์šฉํ•˜์˜€๋‹ค. Teacher ๋ชจ๋ธ์€ ๊ฐ๊ฐ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์— ๋Œ€ํ•ด ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šต๋œ ๋‹จ์ผ ์†์ƒ ๋ถ„ํ•  ๋ชจ๋ธ์ด๋ฉฐ, Student ๋ชจ๋ธ์€ ์„ธ ์†์ƒ์„ ๋™์‹œ์— ์˜ˆ์ธกํ•˜๋Š” Three Multihead ๊ตฌ์กฐ๋กœ ๊ตฌ์„ฑ๋œ๋‹ค. Knowledge Distillation์€ Teacher ๋ชจ๋ธ์˜ ์˜ˆ์ธก ํŠน์„ฑ์„ Student ๋ชจ๋ธ์ด ํ•™์Šตํ•˜๋„๋ก ํ•จ์œผ๋กœ์จ ๊ฐ ์†์ƒ์— ๋Œ€ํ•œ ํŠน์ง• ํ‘œํ˜„ ๋Šฅ๋ ฅ์„ ํšจ๊ณผ์ ์œผ๋กœ ์œ ์ง€ํ•˜๋ฉด์„œ๋„ ํ•˜๋‚˜์˜ ํ†ตํ•ฉ ๋ชจ๋ธ ๋‚ด์—์„œ ๋ณตํ•ฉ ์†์ƒ์„ ๋™์‹œ์— ํ•™์Šตํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•œ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด Teacher์™€ Student์˜ ์˜ˆ์ธก ํ™•๋ฅ  ๋ถ„ํฌ ์ฐจ์ด๋ฅผ ์ตœ์†Œํ™”ํ•˜๋Š” Distillation Loss๋ฅผ ์ ์šฉํ•˜์˜€๋‹ค. Knowledge Distillation Loss๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ •์˜๋œ๋‹ค.

(6)
$L_{KD} = \sum_{c=1}^{C} \|\sigma(\frac{z_c^S}{T}) - \sigma(\frac{z_c^T}{T})\|_2^2$

์—ฌ๊ธฐ์„œ $z_c^S$์™€ $z_c^T$๋Š” ๊ฐ๊ฐ Student ๋ชจ๋ธ๊ณผ Teacher ๋ชจ๋ธ์˜ ํด๋ž˜์Šค c์— ๋Œ€ํ•œ ์ถœ๋ ฅ logit์„ ๋‚˜ํƒ€๋‚ด๋ฉฐ, T๋Š” distillation temperature๋ฅผ ์˜๋ฏธํ•œ๋‹ค. ๋˜ํ•œ $\sigma(\cdot)$๋Š” sigmoid ํ•จ์ˆ˜์ด๋ฉฐ, $\|\cdot\|_2^2$๋Š” Mean Squared Error(MSE) ๊ธฐ๋ฐ˜ ๊ฑฐ๋ฆฌ ์ฒ™๋„๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” Teacher์™€ Student์˜ temperature-scaled sigmoid ํ™•๋ฅ ๋งต ๊ฐ„ ์ฐจ์ด๋ฅผ ์ตœ์†Œํ™”ํ•จ์œผ๋กœ์จ ๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์ด ํ•™์Šตํ•œ ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„ ์ •๋ณด๋ฅผ Student ๋ชจ๋ธ์— ์ „๋‹ฌํ•˜๊ณ ์ž ํ•˜์˜€๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„์„ ์œ ์ง€ํ•˜๋ฉด์„œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ ๋„ํ•˜์˜€๋‹ค.

3.3.3 Pairwise Prior

์‹ค์ œ ์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์ด ๋™์ผ ์˜์ƒ ๋‚ด์—์„œ ํ•จ๊ป˜ ๋‚˜ํƒ€๋‚˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ๋‹ค. ์ด๋Ÿฌํ•œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค๊ฐ€ ๋™์ผ ์˜์—ญ ๋˜๋Š” ์ธ์ ‘ ์˜์—ญ์—์„œ ๋™์‹œ์— ํ™œ์„ฑํ™”๋˜๋ฉด์„œ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ๊ณผ๊ฒ€์ถœ์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ์ผ๋ฐ˜์ ์ธ ๋‹ค์ค‘ ํด๋ž˜์Šค ๋ถ„ํ•  ๋ชจ๋ธ์€ ๊ฐ ์†์ƒ ํด๋ž˜์Šค๋ฅผ ๋…๋ฆฝ์ ์œผ๋กœ ํ•™์Šตํ•˜๊ธฐ ๋•Œ๋ฌธ์— ์†์ƒ ๊ฐ„ ๊ณต๊ฐ„์  ๊ด€๊ณ„์™€ ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ์ถฉ๋ถ„ํžˆ ๋ฐ˜์˜ํ•˜๊ธฐ ์–ด๋ ต๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ฐœ์ƒํ•˜๋Š” ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ์„ ์™„ํ™”ํ•˜๊ณ  ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Pairwise Prior๋ฅผ ๋„์ž…ํ•˜์˜€๋‹ค. Pairwise Prior Loss๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ •์˜๋œ๋‹ค.

(7)
$L_{pair} = \sum_{i,j} R_{ij} \cdot \|P_i \odot P_j\|_1$

์—ฌ๊ธฐ์„œ $P_i$์™€ $P_j$๋Š” ๊ฐ๊ฐ ์†์ƒ ํด๋ž˜์Šค i์™€ j์˜ ์˜ˆ์ธก ํ™•๋ฅ ๋งต์„ ๋‚˜ํƒ€๋‚ด๋ฉฐ, $R_{ij}$๋Š” ์†์ƒ ํด๋ž˜์Šค ์Œ(i, j)์— ๋Œ€ํ•œ Pairwise Prior Loss์˜ ์ƒ๋Œ€์  ๊ธฐ์—ฌ๋„๋ฅผ ์กฐ์ ˆํ•˜๋Š” ๊ด€๊ณ„ ๊ฐ€์ค‘์น˜์ด๋‹ค. ๋˜ํ•œ $\odot$๋Š” ์›์†Œ๋ณ„ ๊ณฑ์„ ์˜๋ฏธํ•˜๋ฉฐ, $\|\cdot\|_1$๋Š” L1 norm์„ ๋‚˜ํƒ€๋‚ธ๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ํŠน์ • ์†์ƒ ์กฐํ•ฉ์˜ ๊ณต์กด ๊ฐ€๋Šฅ์„ฑ์„ ์ฐจ๋“ฑ์ ์œผ๋กœ ๊ฐ•์ œํ•˜๊ธฐ๋ณด๋‹ค๋Š” Pairwise Prior์˜ ๊ธฐ๋ณธ ํšจ๊ณผ๋ฅผ ๋™์ผํ•œ ์กฐ๊ฑด์—์„œ ๊ฒ€์ฆํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ๋ชจ๋“  ์†์ƒ ํด๋ž˜์Šค ์กฐํ•ฉ์— ๋™์ผํ•œ ๊ฐ€์ค‘์น˜ $R_{ij} = 1$์„ ์ ์šฉํ•˜์˜€๋‹ค. ํ•ด๋‹น ๊ฐ’์€ ํ•™์Šต ๊ณผ์ •์—์„œ ๊ณ ์ •ํ•˜์˜€์œผ๋ฉฐ, ๋ชจ๋“  ๋น„๊ต ์‹คํ—˜๊ณผ Ablation Study์— ๋™์ผํ•˜๊ฒŒ ์‚ฌ์šฉํ•˜์˜€๋‹ค. ๋”ฐ๋ผ์„œ $R_{ij}$๋Š” ์†์ƒ ์กฐํ•ฉ๋ณ„ ๊ณต์กด ํ™•๋ฅ ์„ ์ง์ ‘ ์˜๋ฏธํ•˜๋Š” ๊ฐ’์ด ์•„๋‹ˆ๋ผ, ํด๋ž˜์Šค ์Œ๋ณ„ ์ •๊ทœํ™” ํ•ญ์˜ ์ƒ๋Œ€์  ํฌ๊ธฐ๋ฅผ ์กฐ์ ˆํ•˜๋Š” ๊ณ„์ˆ˜๋กœ ํ•ด์„๋œ๋‹ค.

๋ณธ ์—ฐ๊ตฌ์˜ Pairwise Prior๋Š” Eq. (7)๊ณผ ๊ฐ™์ด ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ์˜ˆ์ธก ํ™•๋ฅ ๋งต์˜ ์ƒํ˜ธ์ž‘์šฉ์„ ๋ฐ˜์˜ํ•˜๋Š” ์ •๊ทœํ™” ํ•ญ์œผ๋กœ ๊ตฌ์„ฑํ•˜์˜€๋‹ค. ์‹ค์ œ ๊ตฌํ˜„์—์„œ๋Š” ์ฒ ๊ทผ๋…ธ์ถœ์ด ๋ฐ•๋ฝ ์˜์—ญ๋ณด๋‹ค ๊ณผ๋„ํ•˜๊ฒŒ ํ™•์žฅ๋˜๋Š” ๊ฒฝ์šฐ๋ฅผ ์–ต์ œํ•˜๊ณ , ์ฒ ๊ทผ๋…ธ์ถœ ์ฃผ๋ณ€์—์„œ ๋ฐ•๋ฝ ๋ฐ ๊ท ์—ด์ด ๋‚˜ํƒ€๋‚  ์ˆ˜ ์žˆ๋Š” ๊ณต๊ฐ„์  ๊ด€๊ณ„๋ฅผ ๊ณ ๋ คํ•˜๋„๋ก ์„ค๊ณ„ํ•˜์˜€๋‹ค. ๋˜ํ•œ ๊ท ์—ด์ด ์ฒ ๊ทผ๋…ธ์ถœ ๋˜๋Š” ๋ฐ•๋ฝ๊ณผ ๋ฌด๊ด€ํ•˜๊ฒŒ ๊ณผ๋„ํ•˜๊ฒŒ ํ™œ์„ฑํ™”๋˜๋Š” ๊ฒฝ์šฐ๋ฅผ ์™„ํ™”ํ•จ์œผ๋กœ์จ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋Š” ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ์„ ์ค„์ด๊ณ ์ž ํ•˜์˜€๋‹ค.

๋”ฐ๋ผ์„œ Pairwise Prior๋Š” ํŠน์ • ์†์ƒ ์กฐํ•ฉ์˜ ๊ณต์กด์„ ์ผ๋ฅ ์ ์œผ๋กœ ๊ฐ•์ œํ•˜๋Š” ํ•ญ์ด ์•„๋‹ˆ๋ผ, ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜์—ฌ ์˜ˆ์ธก ๊ฒฐ๊ณผ์˜ ๊ตฌ์กฐ์  ์ •ํ•ฉ์„ฑ์„ ํ–ฅ์ƒ์‹œํ‚ค๊ธฐ ์œ„ํ•œ ์ •๊ทœํ™” ํ•ญ์œผ๋กœ ์‚ฌ์šฉ๋˜์—ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„์˜ ์ผ๊ด€์„ฑ์„ ์œ ์ง€ํ•˜๋ฉด์„œ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ์„ ์™„ํ™”ํ•˜๊ณ , ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋ถ„ํ•  ์„ฑ๋Šฅ์„ ์œ ๋„ํ•  ์ˆ˜ ์žˆ๋‹ค. ํŠนํžˆ ์ด๋Ÿฌํ•œ ๊ณต๊ฐ„์  ๊ด€๊ณ„๋Š” ์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์—์„œ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์ด ๋…๋ฆฝ์ ์œผ๋กœ ๋ฐœ์ƒํ•˜๊ธฐ๋ณด๋‹ค๋Š” ๊ณต๊ฐ„์ ์œผ๋กœ ์ธ์ ‘ํ•˜์—ฌ ๋‚˜ํƒ€๋‚˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ๋‹ค๋Š” ๊ตฌ์กฐ์  ํŠน์„ฑ์„ ๋ฐ˜์˜ํ•œ ๊ฒƒ์œผ๋กœ, ์†์ƒ ๊ฐ„ ๊ณต๊ฐ„์  ์—ฐ๊ด€์„ฑ์„ ๊ณ ๋ คํ•œ ๋ณด๋‹ค ํ˜„์‹ค์ ์ธ ๋ณตํ•ฉ ์†์ƒ ์˜ˆ์ธก์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•œ๋‹ค.

3.3.4 Extra Loss

Pairwise Prior๊ฐ€ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜๋Š” ์ •๊ทœํ™” ํ•ญ์ด๋ผ๋ฉด, Extra Loss๋Š” ๋™์ผ ํ”ฝ์…€ ์œ„์น˜์—์„œ ๋ฐœ์ƒํ•˜๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค์˜ ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์ง์ ‘ ์–ต์ œํ•˜๊ธฐ ์œ„ํ•œ ์†์‹ค ํ•ญ์ด๋‹ค. ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• ์—์„œ๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค๊ฐ€ ๋™์ผ ํ”ฝ์…€ ์œ„์น˜์—์„œ ๋™์‹œ์— ๋†’์€ ํ™•๋ฅ ๋กœ ์˜ˆ์ธก๋˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด ํ•˜๋‚˜์˜ ํ”ฝ์…€์ด ๊ท ์—ด๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ ๋˜๋Š” ๋ฐ•๋ฝ์œผ๋กœ ๋™์‹œ์— ํ™œ์„ฑํ™”๋  ๊ฒฝ์šฐ ์‹ค์ œ ์†์ƒ ๊ตฌ์กฐ์™€ ์ผ์น˜ํ•˜์ง€ ์•Š๋Š” ์ค‘๋ณต ์˜ˆ์ธก์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ด๋Š” ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ํŒ๋ณ„๋ ฅ์„ ์ €ํ•˜์‹œํ‚ค๊ณ  ๊ฒฐ๊ณผ ํ•ด์„์˜ ์‹ ๋ขฐ๋„๋ฅผ ๊ฐ์†Œ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ์ด๋Ÿฌํ•œ ๋ฌธ์ œ๋ฅผ ์™„ํ™”ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Extra Loss๋ฅผ ๋„์ž…ํ•˜์˜€๋‹ค. Extra Loss๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ •์˜๋œ๋‹ค.

(8)
$L_{extra} = \sum_{i \neq j} \|P_i \odot P_j\|_1$

์—ฌ๊ธฐ์„œ $P_i$์™€ $P_j$๋Š” ๊ฐ๊ฐ ์†์ƒ ํด๋ž˜์Šค i์™€ j์˜ ์˜ˆ์ธก ํ™•๋ฅ ๋งต์„ ์˜๋ฏธํ•œ๋‹ค. Eq. (8)์€ ์„œ๋กœ ๋‹ค๋ฅธ ์†์ƒ ํด๋ž˜์Šค๊ฐ€ ๋™์ผ ํ”ฝ์…€ ์œ„์น˜์—์„œ ๋™์‹œ์— ๋†’์€ ํ™•๋ฅ ์„ ๊ฐ€์ง€๋Š” ๊ฒฝ์šฐ ํŒจ๋„ํ‹ฐ๋ฅผ ๋ถ€์—ฌํ•จ์œผ๋กœ์จ ํด๋ž˜์Šค ๊ฐ„ ์ค‘๋ณต ์˜ˆ์ธก์„ ๊ฐ์†Œ์‹œํ‚ค๋„๋ก ์„ค๊ณ„๋˜์—ˆ๋‹ค.

๋”ฐ๋ผ์„œ Pairwise Prior์™€ Extra Loss๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ๋ชฉ์ ์„ ๊ฐ€์ง€๋ฉฐ ์ƒํ˜ธ ๋ณด์™„์ ์œผ๋กœ ์ž‘์šฉํ•œ๋‹ค. Pairwise Prior๋Š” ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ํ•™์Šต ๊ณผ์ •์— ๋ฐ˜์˜ํ•˜๋Š” ์ •๊ทœํ™” ํ•ญ์œผ๋กœ ์ž‘์šฉํ•˜๋ฉฐ, Extra Loss๋Š” ๋ชจ๋“  ์†์ƒ ํด๋ž˜์Šค ์Œ์— ๋Œ€ํ•ด ๋™์ผ ํ”ฝ์…€ ์œ„์น˜์—์„œ ๋ฐœ์ƒํ•˜๋Š” ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์ง์ ‘ ์–ต์ œํ•˜๋Š” ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•œ๋‹ค. ๋‘ ์†์‹ค ํ•จ์ˆ˜๋Š” ์ƒํ˜ธ ๋ณด์™„์ ์œผ๋กœ ์ž‘์šฉํ•˜์—ฌ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ์ค‘๋ณต ์˜ˆ์ธก์„ ๊ฐ์†Œ์‹œํ‚ค๊ณ  ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ๊ฒฐ๊ณผ๋ฅผ ์œ ๋„ํ•œ๋‹ค.

3.3.5 Final Loss Function

์ œ์•ˆ๋œ Three-Multihead Student ๋ชจ๋ธ์€ ๊ธฐ๋ณธ ๋ถ„ํ•  ์†์‹ค, Knowledge Distillation Loss, Pairwise Prior Loss ๋ฐ Extra Loss๋ฅผ ํ†ตํ•ฉํ•˜์—ฌ ํ•™์Šต๋œ๋‹ค. ์ตœ์ข… ์†์‹ค ํ•จ์ˆ˜๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ •์˜๋œ๋‹ค.

(9)
$L_{total} = L_{seg} + \lambda_{KD} L_{KD} + \lambda_{pair} L_{pair} + \lambda_{extra} L_{extra}$

์—ฌ๊ธฐ์„œ $L_{seg}$๋Š” ๊ธฐ๋ณธ ๋ถ„ํ•  ์†์‹ค ํ•จ์ˆ˜์ด๋ฉฐ, $L_{KD}$, $L_{pair}$, $L_{extra}$๋Š” ๊ฐ๊ฐ Knowledge Distillation, Pairwise Prior ๋ฐ Extra Loss๋ฅผ ์˜๋ฏธํ•œ๋‹ค. ๋˜ํ•œ $\lambda_{KD}$, $\lambda_{pair}$, $\lambda_{extra}$๋Š” ๊ฐ ์†์‹ค ํ•ญ์˜ ์ƒ๋Œ€์  ์ค‘์š”๋„๋ฅผ ์กฐ์ ˆํ•˜๋Š” ๊ฐ€์ค‘์น˜์ด๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” KD temperature์™€ ์†์ƒ๋ณ„ KD ๊ฐ€์ค‘์น˜๋ฅผ ์„ ํ–‰์—ฐ๊ตฌ ๋ฐ ์˜ˆ๋น„ ์‹คํ—˜ ๊ฒฐ๊ณผ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์„ค์ •ํ•˜์˜€๋‹ค. ํŠนํžˆ KD temperature๋Š” ์„ ํ–‰์—ฐ๊ตฌ์—์„œ ์ผ๋ฐ˜์ ์œผ๋กœ ์‚ฌ์šฉ๋˜๋Š” ๋ฒ”์œ„๋ฅผ ์ฐธ๊ณ ํ•˜์—ฌ 2.0์œผ๋กœ ์„ค์ •ํ•˜์˜€์œผ๋ฉฐ, ์†์ƒ๋ณ„ KD ๊ฐ€์ค‘์น˜๋Š” ์˜ˆ๋น„ ์‹คํ—˜์„ ํ†ตํ•ด ๊ฒฐ์ •ํ•˜์˜€๋‹ค. ์ตœ์ข… ์†์‹ค ํ•จ์ˆ˜๋Š” ๊ธฐ๋ณธ ๋ถ„ํ•  ์„ฑ๋Šฅ์„ ์œ ์ง€ํ•˜๋ฉด์„œ ๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์˜ ์ง€์‹์„ ํ™œ์šฉํ•˜๊ณ , ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด์™€ ์ค‘๋ณต ํ™œ์„ฑํ™” ์ œ์•ฝ์„ ๋™์‹œ์— ๋ฐ˜์˜ํ•˜๋„๋ก ๊ตฌ์„ฑ๋˜์—ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์ œ์•ˆ ๋ชจ๋ธ์€ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋Š” ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ์ค‘๋ณต ์˜ˆ์ธก์„ ์™„ํ™”ํ•˜๊ณ  ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ์„ ํ™•๋ณดํ•˜๋„๋ก ์„ค๊ณ„๋˜์—ˆ๋‹ค.

4. Experimental Results and Analysis

4.1 Baseline Model and Proposed Full Model Comparison

Table 3๊ณผ ๊ฐ™์ด ๊ธฐ์ค€ ๋ชจ๋ธ์€ ์ œ์•ˆ ๋ชจ๋ธ๊ณผ ๋™์ผํ•œ ๊ณต์œ  ์ธ์ฝ”๋” ๋ฐ Multihead ๊ตฌ์กฐ๋ฅผ ์‚ฌ์šฉํ•˜๋˜, Knowledge Distillation, Pairwise Prior ๋ฐ Extra Loss๋ฅผ ์ ์šฉํ•˜์ง€ ์•Š์€ ๋ชจ๋ธ๋กœ ์ •์˜ํ•˜์˜€๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋„คํŠธ์›Œํฌ ๊ตฌ์กฐ์˜ ์ฐจ์ด๊ฐ€ ์•„๋‹Œ ํ•™์Šต ์ „๋žต๊ณผ ์†์‹ค ํ•จ์ˆ˜ ์„ค๊ณ„๊ฐ€ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์„ ์ •๋Ÿ‰์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜๊ณ ์ž ํ•˜์˜€๋‹ค.

๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• ์—์„œ๋Š” ๋„คํŠธ์›Œํฌ ๊ตฌ์กฐ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ํ•™์Šต ๋ฐฉ์‹๊ณผ ์†์‹ค ํ•จ์ˆ˜ ๊ตฌ์„ฑ์— ๋”ฐ๋ผ์„œ๋„ ์„ฑ๋Šฅ ์ฐจ์ด๊ฐ€ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ๋”ฐ๋ผ์„œ ๊ณต์ •ํ•œ ๋น„๊ต๋ฅผ ์œ„ํ•˜์—ฌ ๊ธฐ์ค€ ๋ชจ๋ธ๊ณผ ์ œ์•ˆ ๋ชจ๋ธ์€ ๋™์ผํ•œ ๋„คํŠธ์›Œํฌ ๊ตฌ์กฐ๋ฅผ ์‚ฌ์šฉํ•˜์˜€์œผ๋ฉฐ, ๋‘ ๋ชจ๋ธ ๊ฐ„ ์ฐจ์ด๋Š” Knowledge Distillation, Pairwise Prior ๋ฐ Extra Loss์˜ ์ ์šฉ ์—ฌ๋ถ€๋กœ ์ œํ•œํ•˜์˜€๋‹ค.

Table 3. Quantitative Comparison between Baseline and Proposed Full Model

Component Shared Encoder Multihead Outputs Knowledge Distillation Pairwise prior Extra Loss
Baseline Model โœ” โœ” โœ– โœ– โœ–
Proposed Full Model โœ” โœ” โœ” โœ” โœ”

์‹คํ—˜ ๊ฒฐ๊ณผ(Table 4), ์ œ์•ˆ ๋ชจ๋ธ์€ ๋ชจ๋“  ์†์ƒ ์œ ํ˜•์—์„œ ๊ธฐ์ค€ ๋ชจ๋ธ๋ณด๋‹ค ํ–ฅ์ƒ๋œ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ๊ท ์—ด์˜ Dice score๋Š” 0.26์—์„œ 0.32๋กœ ์ฆ๊ฐ€ํ•˜์—ฌ ์•ฝ 23.0 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋ณด์˜€์œผ๋ฉฐ, ์ฒ ๊ทผ๋…ธ์ถœ์€ 0.39์—์„œ 0.45๋กœ ์ฆ๊ฐ€ํ•˜์—ฌ ์•ฝ 15.3 %, ๋ฐ•๋ฝ์€ 0.46์—์„œ 0.49๋กœ ์ฆ๊ฐ€ํ•˜์—ฌ ์•ฝ 6.5 % ํ–ฅ์ƒ๋˜์—ˆ๋‹ค. ์„ธ ์†์ƒ์˜ ํ‰๊ท  Dice๋Š” 0.37์—์„œ 0.42๋กœ ํ–ฅ์ƒ๋˜์–ด ์•ฝ 13.5 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ํŠนํžˆ ๊ท ์—ด ํด๋ž˜์Šค์—์„œ ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ํ–ฅ์ƒ์ด ๊ด€์ฐฐ๋˜์—ˆ๋‹ค. ์ด๋Š” Knowledge Distillation์„ ํ†ตํ•œ ์†์ƒ๋ณ„ ํŠน์ง• ์ •๋ณด ํ™œ์šฉ๊ณผ Pairwise Prior ๋ฐ Extra Loss์— ์˜ํ•œ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ ์™„ํ™” ํšจ๊ณผ๊ฐ€ ๋ณตํ•ฉ์ ์œผ๋กœ ์ž‘์šฉํ•œ ๊ฒฐ๊ณผ๋กœ ํŒ๋‹จ๋œ๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ์ œ์•ˆ๋œ Three-Multihead ๊ตฌ์กฐ๊ฐ€ ์„œ๋กœ ๋‹ค๋ฅธ ํ˜•์ƒ์  ํŠน์„ฑ์„ ๊ฐ€์ง€๋Š” ์†์ƒ๋“ค์„ ํšจ๊ณผ์ ์œผ๋กœ ๋ถ„๋ฆฌํ•˜๊ณ  ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€๋‹ค.

ํ•œํŽธ Table 2์˜ ๋‹จ์ผ ์†์ƒ ๋ถ„ํ•  ๊ฒฐ๊ณผ์™€ ๋น„๊ตํ•˜๋ฉด Table 4์˜ Dice ๊ฐ’์€ ์ „๋ฐ˜์ ์œผ๋กœ ๋‚ฎ๊ฒŒ ๋‚˜ํƒ€๋‚ฌ๋‹ค. ์ด๋Š” ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• ์ด ์—ฌ๋Ÿฌ ์†์ƒ์„ ๋™์‹œ์— ๊ตฌ๋ถ„ํ•ด์•ผ ํ•˜๋Š” ๋ณด๋‹ค ์–ด๋ ค์šด ๋ฌธ์ œ์ด๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค. ๋”ฐ๋ผ์„œ ๋ณธ ๊ฒฐ๊ณผ๋Š” ์ ˆ๋Œ€์ ์ธ ์„ฑ๋Šฅ ์ˆ˜์น˜๋ณด๋‹ค๋Š” ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ ๊ด€์ ์—์„œ ํ•ด์„ํ•˜๋Š” ๊ฒƒ์ด ํƒ€๋‹นํ•˜๋‹ค.

๊ธฐ์ค€ ๋ชจ๋ธ์€ ์—ฌ๋Ÿฌ ์†์ƒ์„ ๋™์‹œ์— ์˜ˆ์ธกํ•  ์ˆ˜ ์žˆ์œผ๋‚˜ ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๊ณ ๋ คํ•˜์ง€ ์•Š๊ธฐ ๋•Œ๋ฌธ์— ๋ฐฐ๊ฒฝ ์˜์—ญ์ด๋‚˜ ์†์ƒ ๊ฒฝ๊ณ„ ๋ถ€๊ทผ์—์„œ ๋ถˆํ•„์š”ํ•œ ํด๋ž˜์Šค ํ™œ์„ฑํ™”๊ฐ€ ๋ฐœ์ƒํ•˜๋Š” ๊ฒฝํ–ฅ์„ ๋ณด์˜€๋‹ค. ๋ฐ˜๋ฉด ์ œ์•ˆ ๋ชจ๋ธ์€ Knowledge Distillation์„ ํ†ตํ•ด ์†์ƒ๋ณ„ ํŠน์ง• ํ‘œํ˜„์„ ์œ ์ง€ํ•˜๊ณ  Pairwise Prior์™€ Extra Loss๋ฅผ ํ†ตํ•ด ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ ๋ฐ ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์™„ํ™”ํ•จ์œผ๋กœ์จ ๋ณด๋‹ค ์•ˆ์ •์ ์ด๊ณ  ์ง‘์ค‘๋œ ์˜ˆ์ธก ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•˜์˜€๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ์ œ์•ˆ๋œ ํ•™์Šต ์ „๋žต์ด ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ํšจ๊ณผ์ ์œผ๋กœ ๊ธฐ์—ฌํ•จ์„ ๋ณด์—ฌ์ค€๋‹ค.

Table 4. Class-wise Performance Comparison

Damage Type Baseline Model Dice Proposed Full Model Dice Improvement Relative Gain (%)
Crack 0.26 0.32 +0.06 +23.0 %
Rebar 0.39 0.45 +0.06 +15.3 %
Spalling 0.46 0.49 +0.03 +6.5 %
Mean 0.37 0.42 +0.05 +13.5 %

Fig. 2์˜ ์ •์„ฑ์  ๋น„๊ต ๊ฒฐ๊ณผ์—์„œ๋„ ์ œ์•ˆ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ ํ–ฅ์ƒ ๊ฒฝํ–ฅ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค. Fig. 2(a)์˜ ์ฒ ๊ทผ๋…ธ์ถœ ์‚ฌ๋ก€์—์„œ ๊ธฐ์ค€ ๋ชจ๋ธ์€ ์‹ค์ œ ์ฒ ๊ทผ๋…ธ์ถœ ์˜์—ญ ์™ธ์—๋„ ์ฃผ๋ณ€ ๋ฐฐ๊ฒฝ ์˜์—ญ์—์„œ ๊ท ์—ด ํด๋ž˜์Šค๊ฐ€ ํ•จ๊ป˜ ํ™œ์„ฑํ™”๋˜๋Š” ์˜ค๊ฒ€์ถœ ํ˜„์ƒ์„ ๋ณด์˜€๋‹ค. ๋ฐ˜๋ฉด ์ œ์•ˆ ๋ชจ๋ธ์€ ์ฒ ๊ทผ๋…ธ์ถœ ์˜์—ญ์— ๋ณด๋‹ค ์ง‘์ค‘๋œ ์˜ˆ์ธก ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•˜์—ฌ ๋ถˆํ•„์š”ํ•œ ํด๋ž˜์Šค ํ™œ์„ฑํ™”๋ฅผ ํšจ๊ณผ์ ์œผ๋กœ ๊ฐ์†Œ์‹œ์ผฐ๋‹ค.

Fig. 2. Qualitative Comparison of Structural Damage Segmentation Results between the Baseline Model and the Proposed Full Model. (a) Rebar Exposure, (b) Spalling, (c) Crack

../../Resources/KSCE/Ksce.2026.46.4.0363/fig2.png

Fig. 2(b)์˜ ๋ฐ•๋ฝ ์‚ฌ๋ก€์—์„œ๋Š” ๊ธฐ์ค€ ๋ชจ๋ธ์ด ์‹ค์ œ ๋ฐ•๋ฝ ์˜์—ญ์˜ ์ผ๋ถ€๋งŒ ๊ฒ€์ถœํ•œ ๋ฐ˜๋ฉด, ์ œ์•ˆ ๋ชจ๋ธ์€ GT์™€ ์œ ์‚ฌํ•œ ํ˜•์ƒ๊ณผ ๋ฒ”์œ„๋ฅผ ๋ณด๋‹ค ์•ˆ์ •์ ์œผ๋กœ ๋ณต์›ํ•˜์˜€๋‹ค. ์ด๋Š” ์ œ์•ˆ ๋ชจ๋ธ์ด ๋ฐ•๋ฝ ์˜์—ญ์˜ ๊ณต๊ฐ„์  ํŠน์„ฑ์„ ๋ณด๋‹ค ํšจ๊ณผ์ ์œผ๋กœ ํ•™์Šตํ•˜์˜€์Œ์„ ์‹œ์‚ฌํ•œ๋‹ค. ๋˜ํ•œ Fig. 2(c)์˜ ๊ท ์—ด ์‚ฌ๋ก€์—์„œ๋Š” ๊ธฐ์ค€ ๋ชจ๋ธ์—์„œ ๋‹ค์ˆ˜์˜ ์‚ฐ๋ฐœ์ ์ธ ์˜ค๊ฒ€์ถœ์ด ๊ด€์ฐฐ๋˜์—ˆ์œผ๋‚˜, ์ œ์•ˆ ๋ชจ๋ธ์€ ๋ฐฐ๊ฒฝ ์˜์—ญ์˜ ๋ถˆํ•„์š”ํ•œ ํ™œ์„ฑํ™”๋ฅผ ๊ฐ์†Œ์‹œํ‚ค๋ฉด์„œ ๊ท ์—ด์˜ ์—ฐ์†์„ฑ๊ณผ ์—ฐ๊ฒฐ์„ฑ์„ ๋ณด๋‹ค ์•ˆ์ •์ ์œผ๋กœ ์œ ์ง€ํ•˜๋Š” ๊ฒฝํ–ฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค.

์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ์ œ์•ˆ ๋ชจ๋ธ์ด ๋‹จ์ˆœํžˆ ์—ฌ๋Ÿฌ ์†์ƒ ํด๋ž˜์Šค๋ฅผ ๋™์‹œ์— ์˜ˆ์ธกํ•˜๋Š” ๊ฒƒ์„ ๋„˜์–ด, Knowledge Distillation์„ ํ†ตํ•œ ์†์ƒ๋ณ„ ํŠน์ง• ์ •๋ณด ํ™œ์šฉ๊ณผ Pairwise Prior ๋ฐ Extra Loss๋ฅผ ํ†ตํ•œ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ ์™„ํ™” ํšจ๊ณผ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€๋‹ค.

4.2 Comparison between Proposed Full Model and Multi-Damage Representation Model

๋ณธ ์ ˆ์—์„œ๋Š” ์ œ์•ˆ ๋ชจ๋ธ๊ณผ Multi-Damage Representation ๋ชจ๋ธ์„ ๋น„๊ตํ•˜์—ฌ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ์˜ ๋ถ„ํ•  ์„ฑ๋Šฅ ์ฐจ์ด๋ฅผ ๋ถ„์„ํ•˜์˜€๋‹ค. Multi-Damage Representation ๋ชจ๋ธ์€ ์—ฌ๋Ÿฌ ์†์ƒ ํด๋ž˜์Šค๋ฅผ ๋™์‹œ์— ํ™œ์„ฑํ™”ํ•  ์ˆ˜ ์žˆ์œผ๋‚˜, ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๋ช…์‹œ์ ์œผ๋กœ ๊ณ ๋ คํ•˜์ง€ ์•Š์•„ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ์ค‘๋ณต ํ™œ์„ฑํ™”๊ฐ€ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ๋ฐ˜๋ฉด ์ œ์•ˆ ๋ชจ๋ธ์€ Pairwise Prior์™€ Extra Loss๋ฅผ ์ ์šฉํ•˜์—ฌ ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๋ฐ˜์˜ํ•˜๊ณ  ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•˜๋„๋ก ์„ค๊ณ„๋˜์—ˆ๋‹ค.

์‹คํ—˜ ๊ฒฐ๊ณผ Multi-Damage Representation ๋ชจ๋ธ์˜ Dice score ํ‰๊ท ์€ 0.35๋ฅผ ๊ธฐ๋กํ•œ ๋ฐ˜๋ฉด, ์ œ์•ˆ ๋ชจ๋ธ์€ 0.42์„ ๊ธฐ๋กํ•˜์—ฌ ์•ฝ 20.0 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ํŠนํžˆ ๊ท ์—ด์€ 0.27์—์„œ 0.32๋กœ ํ–ฅ์ƒ๋˜์—ˆ์œผ๋ฉฐ, ๋ฐ•๋ฝ์€ 0.35์—์„œ 0.49๋กœ ์ฆ๊ฐ€ํ•˜์—ฌ ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋ณด์˜€๋‹ค. ๋ฐ˜๋ฉด ์ฒ ๊ทผ๋…ธ์ถœ์€ ๋‘ ๋ชจ๋ธ ๋ชจ๋‘ ์œ ์‚ฌํ•œ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค.

Table 5. Class-wise Performance Comparison between the Proposed Full Model and the Multi-Damage Representation Model

Model Dice Total Improvement Relative Gain (%)
Crack Rebar Exposure Spalling Mean
Multi-damage Representation 0.27 0.45 0.35 0.35 - -
Proposed Full 0.32 0.45 0.49 0.42 +0.07 20.0

Fig. 3์—์„œ Multi-Damage Representation ๋ชจ๋ธ์€ ์‹ค์ œ ์ฒ ๊ทผ๋…ธ์ถœ ์˜์—ญ์„ ๊ฒ€์ถœํ•˜์˜€์œผ๋‚˜, Ground Truth(GT)์— ์กด์žฌํ•˜์ง€ ์•Š๋Š” ๋ฐ•๋ฝ ๋ฐ ๊ท ์—ด ํด๋ž˜์Šค๊ฐ€ ํ•จ๊ป˜ ํ™œ์„ฑํ™”๋˜๋Š” ํ˜„์ƒ์ด ๊ด€์ฐฐ๋˜์—ˆ๋‹ค. ํŠนํžˆ ์ฒ ๊ทผ๋…ธ์ถœ ์ฃผ๋ณ€ ์˜์—ญ์ด ๋„“์€ ๋ฐ•๋ฝ ์˜์—ญ์œผ๋กœ ์˜ˆ์ธก๋˜๋ฉด์„œ ํด๋ž˜์Šค ๊ฐ„ ์ค‘๋ณต ํ™œ์„ฑํ™”๊ฐ€ ๋ฐœ์ƒํ•˜์˜€๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ์†์ƒ ๊ฐ„ ๊ด€๊ณ„๋ฅผ ๋ช…์‹œ์ ์œผ๋กœ ๊ณ ๋ คํ•˜์ง€ ์•Š์„ ๊ฒฝ์šฐ ์‹ค์ œ ์†์ƒ๊ณผ ๋ฌด๊ด€ํ•œ ํด๋ž˜์Šค๊ฐ€ ๋™์‹œ์— ํ™œ์„ฑํ™”๋  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€๋‹ค. ๋ฐ˜๋ฉด ์ œ์•ˆ ๋ชจ๋ธ์€ ์ฒ ๊ทผ๋…ธ์ถœ ์˜์—ญ์— ์ง‘์ค‘๋œ ์˜ˆ์ธก ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•˜์˜€์œผ๋ฉฐ, GT์— ์กด์žฌํ•˜์ง€ ์•Š๋Š” ๋ฐ•๋ฝ ๋ฐ ๊ท ์—ด ํด๋ž˜์Šค์˜ ํ™œ์„ฑํ™”๋ฅผ ํšจ๊ณผ์ ์œผ๋กœ ์–ต์ œํ•˜์˜€๋‹ค. ์ด๋Š” Pairwise Prior์™€ Extra Loss๊ฐ€ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ์„ ๊ฐ์†Œ์‹œํ‚ค๊ณ  ์ค‘๋ณต ์˜ˆ์ธก์„ ์™„ํ™”ํ•˜๋Š” ๋ฐ ๊ธฐ์—ฌํ•˜์˜€์Œ์„ ๋ณด์—ฌ์ค€๋‹ค.

Fig. 3. Qualitative Comparison of Composite-Damage Segmentation Results among Ground Truth, the Proposed Full Model, and the Multi-Damage Representation Model

../../Resources/KSCE/Ksce.2026.46.4.0363/fig3.png

4.3 Ablation Study

์ œ์•ˆ ๋ชจ๋ธ์„ ๊ตฌ์„ฑํ•˜๋Š” ํ•ต์‹ฌ ์š”์†Œ์ธ Pairwise Prior์™€ Extra Loss์˜ ํšจ๊ณผ๋ฅผ ๋ถ„์„ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Ablation Study๋ฅผ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. Table 6์€ ๊ฐ ๊ตฌ์„ฑ ์š”์†Œ๋ฅผ ์ œ๊ฑฐํ•œ ๊ฒฝ์šฐ์˜ ์„ฑ๋Šฅ ๋ณ€ํ™”๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค.

Table 6. Ablation Study of the Proposed Full Model

Model Crack Rebar Exposure Spalling Mean
Baseline Model 0.26 0.39 0.46 0.37
Without Extra Loss 0.29 0.44 0.39 0.37
Without Pairwise prior 0.30 0.43 0.39 0.37
Proposed Full Model 0.32 0.45 0.49 0.42

Table 6์— ๋”ฐ๋ฅด๋ฉด ์ œ์•ˆ ๋ชจ๋ธ์€ ํ‰๊ท  Dice 0.42๋กœ ๊ฐ€์žฅ ๋†’์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ๋ฐ˜๋ฉด Pairwise Prior ๋˜๋Š” Extra Loss๋ฅผ ์ œ๊ฑฐํ•œ ๊ฒฝ์šฐ ํ‰๊ท  Dice๋Š” ๋ชจ๋‘ 0.37๋กœ ๊ฐ์†Œํ•˜์˜€๋‹ค. ํ‰๊ท  Dice๋งŒ์œผ๋กœ๋Š” ๊ธฐ์ค€ ๋ชจ๋ธ๊ณผ ์œ ์‚ฌํ•œ ์ˆ˜์ค€์œผ๋กœ ๋ณด์ผ ์ˆ˜ ์žˆ์œผ๋‚˜, ํด๋ž˜์Šค๋ณ„ ์„ฑ๋Šฅ ๋ถ„์„ ๊ฒฐ๊ณผ ๋ฐ•๋ฝ ํด๋ž˜์Šค์—์„œ ํ˜„์ €ํ•œ ์„ฑ๋Šฅ ์ €ํ•˜๊ฐ€ ํ™•์ธ๋˜์—ˆ๋‹ค. ํŠนํžˆ ๋‘ ๊ฒฝ์šฐ ๋ชจ๋‘ ๋ฐ•๋ฝ์˜ Dice๊ฐ€ 0.49์—์„œ 0.39๋กœ ํฌ๊ฒŒ ๊ฐ์†Œํ•˜์—ฌ ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ์ €ํ•˜๋ฅผ ๋ณด์˜€๋‹ค. ์ด๋Š” Pairwise Prior๊ฐ€ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ๋ฐ˜์˜ํ•˜์—ฌ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ์„ ์™„ํ™”ํ•˜๊ณ , Extra Loss๊ฐ€ ๋™์ผ ์œ„์น˜์—์„œ ๋ฐœ์ƒํ•˜๋Š” ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•จ์œผ๋กœ์จ ํด๋ž˜์Šค ๊ฐ„ ๊ตฌ๋ถ„์„ฑ์„ ํ–ฅ์ƒ์‹œํ‚ค๊ธฐ ๋•Œ๋ฌธ์œผ๋กœ ํ•ด์„๋œ๋‹ค. ๋”ฐ๋ผ์„œ ๋‘ ์†์‹ค ํ•ญ์€ ์ƒํ˜ธ ๋ณด์™„์ ์œผ๋กœ ์ž‘์šฉํ•˜๋ฉฐ, ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ์•ˆ์ •์ ์ธ ๋‹ค์ค‘ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ ํ™•๋ณด์— ์ค‘์š”ํ•œ ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒƒ์œผ๋กœ ํ™•์ธ๋˜์—ˆ๋‹ค.

4.4 Initial Evaluation on Real Composite-Damage Images

๊ธฐ์กด ์‹คํ—˜์€ ๋‹จ์ผ ์†์ƒ ๋ฐ์ดํ„ฐ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์ˆ˜ํ–‰๋˜์—ˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ์‹ค์ œ ์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์—์„œ๋Š” ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์ด ๋™์‹œ์— ์กด์žฌํ•˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์œผ๋ฏ€๋กœ ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ์˜ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ ๊ฒ€์ฆ์ด ํ•„์š”ํ•˜๋‹ค. ์ด๋ฅผ ์œ„ํ•˜์—ฌ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ ์˜์ƒ์„ ๋Œ€์ƒ์œผ๋กœ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์„ ๊ตฌ์ถ•ํ•˜์˜€๋‹ค. ๋ฐ์ดํ„ฐ์…‹์€ ๊ท ์—ด + ์ฒ ๊ทผ๋…ธ์ถœ, ๊ท ์—ด + ๋ฐ•๋ฝ, ์ฒ ๊ทผ๋…ธ์ถœ + ๋ฐ•๋ฝ ๋ฐ ๊ท ์—ด + ์ฒ ๊ทผ๋…ธ์ถœ + ๋ฐ•๋ฝ์˜ ๋„ค ๊ฐ€์ง€ ๋ณตํ•ฉ ์†์ƒ ์กฐํ•ฉ์œผ๋กœ ๊ตฌ์„ฑํ•˜์˜€์œผ๋ฉฐ, ์ด 44์žฅ์˜ ์ด๋ฏธ์ง€์™€ ๊ท ์—ด 81๊ฐœ, ์ฒ ๊ทผ๋…ธ์ถœ 49๊ฐœ, ๋ฐ•๋ฝ 65๊ฐœ์˜ ์†์ƒ ๋ผ๋ฒจ์„ ํฌํ•จํ•œ๋‹ค. Fig. 4๋Š” ๊ตฌ์ถ•๋œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์˜ ๋Œ€ํ‘œ ์‚ฌ๋ก€๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค.

Fig. 4. Examples of Composite Damage Images and Corresponding Ground-truth Masks. (a) Rebar Exposure + Spalling, (b) Rebar Exposure + Spalling + Crack

../../Resources/KSCE/Ksce.2026.46.4.0363/fig4.png

์ œ์•ˆ๋œ Three-Multihead ๋ชจ๋ธ์„ ์ถ”๊ฐ€ ํ•™์Šต ์—†์ด ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์— ์ ์šฉํ•˜์—ฌ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ์„ ํ‰๊ฐ€ํ•˜์˜€๋‹ค. ํ‰๊ฐ€ ๊ฒฐ๊ณผ๋Š” Table 7 ๋ฐ Table 8๊ณผ ๊ฐ™๋‹ค.

Table 7. Generalization Performance on Real Composite-Damage Images

Damage Combination Dice Damage Combination Dice
Crack + Rebar 0.27 Crack + Rebar + Spalling 0.32
Crack + Spalling 0.31 Rebar + Spalling 0.53

Table 8. Class-wise Evaluation Results on the Composite-Damage Dataset

Damage Type Dice IoU Precision Recall
Crack 0.02 0.01 0.01 0.07
Rebar Exposure 0.47 0.33 0.52 0.47
Spalling 0.58 0.43 0.48 0.76

์‹คํ—˜ ๊ฒฐ๊ณผ(Table 8), ์†์ƒ ์œ ํ˜•๋ณ„๋กœ๋Š” ๋ฐ•๋ฝ(0.58)๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ(0.47)์ด ๋น„๊ต์  ์•ˆ์ •์ ์ธ ์„ฑ๋Šฅ์„ ๋ณด์ธ ๋ฐ˜๋ฉด, ๊ท ์—ด์€ Dice 0.02๋กœ ๋งค์šฐ ๋‚ฎ์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Š” ๋‹จ์ผ ์†์ƒ ๋ฐ์ดํ„ฐ๋กœ ํ•™์Šต๋œ ๋ชจ๋ธ์ด ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋‹ค์–‘ํ•œ ์†์ƒ ์กฐํ•ฉ์„ ์ถฉ๋ถ„ํžˆ ๋ฐ˜์˜ํ•˜์ง€ ๋ชปํ–ˆ๊ธฐ ๋•Œ๋ฌธ์œผ๋กœ ํŒ๋‹จ๋œ๋‹ค. ํŠนํžˆ ๊ท ์—ด์€ ์ธ์ ‘ ์†์ƒ ๋ฐ ๋ฐฐ๊ฒฝ ํŒจํ„ด์˜ ์˜ํ–ฅ์„ ํฌ๊ฒŒ ๋ฐ›์•„ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ์ด ํ˜„์ €ํžˆ ์ €ํ•˜๋˜๋Š” ๊ฒƒ์œผ๋กœ ๋‚˜ํƒ€๋‚ฌ๋‹ค.

4.5 Fine-Tuning and Threshold Optimization

์•ž ์ ˆ์˜ ๊ฒฐ๊ณผ์—์„œ ํ™•์ธํ•œ ๋ฐ”์™€ ๊ฐ™์ด, ์ œ์•ˆ๋œ Three-Multihead ๋ชจ๋ธ์€ ์ถ”๊ฐ€ ํ•™์Šต ์—†์ด ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์— ์ ์šฉํ•˜์˜€์„ ๋•Œ ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์— ๋Œ€ํ•ด์„œ๋Š” ์ผ์ • ์ˆ˜์ค€์˜ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ์„ ์œ ์ง€ํ•˜์˜€์œผ๋‚˜, ๊ท ์—ด์˜ ๊ฒฝ์šฐ ๋งค์šฐ ๋‚ฎ์€ ๊ฒ€์ถœ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Š” ๋‹จ์ผ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•™์Šต๋œ ํŠน์ง• ํ‘œํ˜„์ด ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ๋‚˜ํƒ€๋‚˜๋Š” ๋‹ค์–‘ํ•œ ์†์ƒ ์กฐํ•ฉ๊ณผ ์‹œ๊ฐ์  ๊ฐ„์„ญ์„ ์ถฉ๋ถ„ํžˆ ๋ฐ˜์˜ํ•˜์ง€ ๋ชปํ–ˆ๊ธฐ ๋•Œ๋ฌธ์œผ๋กœ ํŒ๋‹จ๋œ๋‹ค. ์ด์— ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๊ตฌ์ถ•ํ•œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์„ ์ด์šฉํ•˜์—ฌ ์ œ์•ˆ ๋ชจ๋ธ์— ๋Œ€ํ•œ ์ถ”๊ฐ€ Fine-Tuning์„ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. Fine-Tuning์€ ์ œ์•ˆ๋œ Full Model์˜ ํ•™์Šต ๊ฐ€์ค‘์น˜๋ฅผ ์ดˆ๊ธฐ๊ฐ’์œผ๋กœ ์‚ฌ์šฉํ•˜์˜€์œผ๋ฉฐ, ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ๋Šฅ๋ ฅ ํ–ฅ์ƒ์„ ๋ชฉ์ ์œผ๋กœ ์ˆ˜ํ–‰๋˜์—ˆ๋‹ค. Table 9๋Š” Fine-Tuning ์ „ํ›„์˜ ์ „์ฒด ์„ฑ๋Šฅ ๋ณ€ํ™”๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค.

Table 9. Comparison of Mean Dice before and after Fine-Tuning

Metric Before Fine-Tuning After Fine-Tuning Improvement
Mean Dice 0.35 0.57 +0.22

Fine-Tuning ๊ฒฐ๊ณผ ์ „์ฒด ํ‰๊ท  Dice๋Š” 0.35์—์„œ 0.57๋กœ ํ–ฅ์ƒ๋˜์—ˆ์œผ๋ฉฐ, ์•ฝ 62.8 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Š” ์ œํ•œ๋œ ์ˆ˜์˜ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ๋งŒ์œผ๋กœ๋„ ์‹ค์ œ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ์„ฑ๋Šฅ์ด ํฌ๊ฒŒ ํ–ฅ์ƒ๋  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€๋‹ค. ์ถ”๊ฐ€์ ์œผ๋กœ Fine-Tuned ๋ชจ๋ธ์˜ ์ถœ๋ ฅ ํ™•๋ฅ ๋งต์— ๋Œ€ํ•ด ํด๋ž˜์Šค๋ณ„ Threshold Optimization์„ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ๊ฐ ์†์ƒ ํด๋ž˜์Šค๋ณ„๋กœ threshold sweep์„ ์ˆ˜ํ–‰ํ•œ ํ›„ ๊ฒ€์ฆ ๋ฐ์ดํ„ฐ์…‹์—์„œ Dice score๊ฐ€ ์ตœ๋Œ€๊ฐ€ ๋˜๋Š” ๊ฐ’์„ ์ตœ์  threshold๋กœ ์„ ์ •ํ•˜์˜€๋‹ค.

Threshold Optimization ์ดํ›„ ์ „์ฒด ํ‰๊ท  Dice๋Š” 0.58๋กœ ๋‚˜ํƒ€๋‚˜ Fine-Tuning ์งํ›„์˜ 0.57๊ณผ ์œ ์‚ฌํ•œ ์ˆ˜์ค€์„ ์œ ์ง€ํ•˜์˜€๋‹ค. ๋”ฐ๋ผ์„œ ํด๋ž˜์Šค๋ณ„ ์ž„๊ณ„๊ฐ’ ์กฐ์ •์— ๋”ฐ๋ฅธ ์ „์ฒด ํ‰๊ท  ์„ฑ๋Šฅ์˜ ์ถ”๊ฐ€ ํ–ฅ์ƒ ํญ์€ ์ œํ•œ์ ์ด์—ˆ๋‹ค. ๋‹ค๋งŒ ๊ท ์—ด๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ์ฒ˜๋Ÿผ ์ถœ๋ ฅ ํ™•๋ฅ  ๋ถ„ํฌ์™€ ๊ธฐ๋ณธ ์ž„๊ณ„๊ฐ’์— ๋ฏผ๊ฐํ•œ ํด๋ž˜์Šค์—์„œ๋Š” Precision๊ณผ Recall์˜ ๊ท ํ˜•์„ ์กฐ์ •ํ•˜๋Š” ๋ณด์ • ํšจ๊ณผ๊ฐ€ ํ™•์ธ๋˜์—ˆ๋‹ค. ์ด์— ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” Threshold Optimization์„ ์ „์ฒด ์„ฑ๋Šฅ์„ ํฌ๊ฒŒ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๋…๋ฆฝ์  ํ•™์Šต ๊ธฐ๋ฒ•์ด๋ผ๊ธฐ๋ณด๋‹ค, Fine-Tuned ๋ชจ๋ธ์˜ ํด๋ž˜์Šค๋ณ„ ์ถœ๋ ฅ ํŠน์„ฑ์„ ์กฐ์ •ํ•˜๋Š” ํ›„์ฒ˜๋ฆฌ ๊ธฐ๋ฐ˜ calibration ๋‹จ๊ณ„๋กœ ํ•ด์„ํ•˜์˜€๋‹ค.

Table 10. Best Threshold and Class-Wise Performance after Threshold Sweep

Class Optimal Threshold Dice IoU Precision Recall
Crack 0.40 0.36 (0.02) 0.23 0.30 0.50
Rebar Exposure 0.25 0.60 (0.47) 0.46 0.61 0.77
Spalling 0.55 0.79 (0.58) 0.67 0.77 0.83
Mean 0.40 0.58 0.45 0.56 0.70

[i] Note: Values in parentheses indicate Dice scores before fine-tuning and class-specific threshold optimization.

Fig. 5๋Š” Fine-Tuning ๋ฐ ํด๋ž˜์Šค๋ณ„ Threshold Optimization ์ดํ›„์˜ ๋Œ€ํ‘œ์ ์ธ ์ •์„ฑ์  ๊ฒฐ๊ณผ๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค. ์ฒ ๊ทผ๋…ธ์ถœ๊ณผ ๋ฐ•๋ฝ์ด ๋™์‹œ์— ์กด์žฌํ•˜๋Š” ๊ฒฝ์šฐ ๋‘ ์†์ƒ ์˜์—ญ์ด ๋น„๊ต์  ๋ช…ํ™•ํ•˜๊ฒŒ ๋ถ„๋ฆฌ๋˜์—ˆ์œผ๋ฉฐ, ๊ท ์—ด์ด ํฌํ•จ๋œ ๋ณตํ•ฉ ์†์ƒ ์‚ฌ๋ก€์—์„œ๋„ ์‹ค์ œ ์†์ƒ ๊ตฌ์กฐ์™€์˜ ์ •ํ•ฉ์„ฑ์ด ๊ฐœ์„ ๋˜๋Š” ๊ฒฝํ–ฅ์„ ํ™•์ธํ•˜์˜€๋‹ค. ๋‹ค๋งŒ Threshold Optimization์— ๋”ฐ๋ฅธ ์ „์ฒด ํ‰๊ท  ์„ฑ๋Šฅ ํ–ฅ์ƒ ํญ์€ ์ œํ•œ์ ์ด๋ฏ€๋กœ, ๋ณธ ๊ฒฐ๊ณผ๋Š” ํด๋ž˜์Šค๋ณ„ ์˜ˆ์ธก ๊ท ํ˜•์„ ์กฐ์ •ํ•œ ๋ณด์ • ํšจ๊ณผ์˜ ๊ด€์ ์—์„œ ํ•ด์„ํ•˜์˜€๋‹ค. ๋งˆ์ง€๋ง‰์œผ๋กœ Table 11์€ ๋ณตํ•ฉ ์†์ƒ ์กฐํ•ฉ๋ณ„ ์„ฑ๋Šฅ ํ‰๊ฐ€ ๊ฒฐ๊ณผ๋ฅผ ๋‚˜ํƒ€๋‚ธ๋‹ค.

Fig. 5. Representative Segmentation Results after Fine-tuning and Class-specific Threshold Optimization on the Composite-damage Dataset. (a) Rebar Exposure + Spalling (Composite-Damage Dice = 0.80), (b) Rebar Exposure + Spalling (Composite-Damage Dice = 0.72), (c) Crack + Rebar Exposure + Spalling (Composite-Damage Dice = 0.65)

../../Resources/KSCE/Ksce.2026.46.4.0363/fig5.png

Table 11. Case-wise Performance after Applying Class-Specific Thresholds

Damage Combination Mean Dice Mean IoU
Crack + Rebar 0.43 0.31
Crack + Rebar + Spalling 0.64 0.50
Crack + Spalling 0.67 0.55
Rebar + Spalling 0.62 0.50
Overall Mean 0.58 0.45

Table 11์— ๋”ฐ๋ฅด๋ฉด ๋ณตํ•ฉ ์†์ƒ ์กฐํ•ฉ๋ณ„ ์„ฑ๋Šฅ์€ ํ‰๊ท  Dice 0.43~0.67 ๋ฒ”์œ„๋กœ ๋‚˜ํƒ€๋‚ฌ์œผ๋ฉฐ, Crack + Spalling ์กฐํ•ฉ์—์„œ ๊ฐ€์žฅ ๋†’์€ ์„ฑ๋Šฅ(0.67)์„ ๊ธฐ๋กํ•˜์˜€๋‹ค. ๋ฐ˜๋ฉด Crack + Rebar ์กฐํ•ฉ์€ 0.43์œผ๋กœ ๊ฐ€์žฅ ๋‚ฎ์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Š” ๊ท ์—ด๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ์ด ํ•จ๊ป˜ ์กด์žฌํ•  ๊ฒฝ์šฐ ๋‘ ์†์ƒ์˜ ์„ ํ˜•์  ํŠน์ง•๊ณผ ์ฃผ๋ณ€ ์Œ์˜์ด ์„œ๋กœ ๊ฐ„์„ญํ•˜์—ฌ ์˜ˆ์ธก ๋‚œ์ด๋„๊ฐ€ ์ฆ๊ฐ€ํ•˜๊ธฐ ๋•Œ๋ฌธ์œผ๋กœ ํŒ๋‹จ๋œ๋‹ค.

๋˜ํ•œ Ablation Study ๊ฒฐ๊ณผ Pairwise Prior์™€ Extra Loss๊ฐ€ ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ๊ฐ€์žฅ ํฌ๊ฒŒ ๊ธฐ์—ฌํ•˜๋Š” ๊ฒƒ์œผ๋กœ ํ™•์ธ๋˜์—ˆ์œผ๋ฉฐ, ์ด๋Š” ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด์™€ ์ค‘๋ณต ํ™œ์„ฑํ™” ์–ต์ œ๊ฐ€ ์ค‘์š”ํ•œ ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•จ์„ ๋ณด์—ฌ์ค€๋‹ค. ์ถ”๊ฐ€์ ์œผ๋กœ, ์ œ์•ˆ ๋ชจ๋ธ์€ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ Fine-Tuning์„ ํ†ตํ•ด ํ‰๊ท  Dice๋ฅผ 0.35์—์„œ 0.58๊นŒ์ง€ ํ–ฅ์ƒ์‹œ์ผฐ๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์˜ ๊ทœ๋ชจ์™€ ๋‹ค์–‘์„ฑ์ด ํ™•๋Œ€๋  ๊ฒฝ์šฐ ์ถ”๊ฐ€์ ์ธ ์„ฑ๋Šฅ ํ–ฅ์ƒ์ด ๊ฐ€๋Šฅํ•จ์„ ์‹œ์‚ฌํ•œ๋‹ค. ๋”ฐ๋ผ์„œ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ ์ ๊ฒ€ ํ™˜๊ฒฝ์— ์ ์šฉํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ๋‹ค์–‘ํ•œ ๋ณตํ•ฉ ์†์ƒ ์‚ฌ๋ก€๋ฅผ ํฌํ•จํ•œ ๋ฐ์ดํ„ฐ์…‹ ๊ตฌ์ถ•์ด ์ค‘์š”ํ•˜๋ฉฐ, ํ–ฅํ›„ ๋Œ€๊ทœ๋ชจ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ํ•™์Šต์„ ํ†ตํ•ด ๋ณด๋‹ค ๋†’์€ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ ํ™•๋ณด๊ฐ€ ๊ฐ€๋Šฅํ•  ๊ฒƒ์œผ๋กœ ๊ธฐ๋Œ€๋œ๋‹ค.

4.6 Comparison between Single-Damage and Composite-Damage Performance

Table 12์— ๋”ฐ๋ฅด๋ฉด ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ๋Š” ๋ชจ๋“  ์†์ƒ ์œ ํ˜•์—์„œ ๋‹จ์ผ ์†์ƒ ํ™˜๊ฒฝ ๋Œ€๋น„ ์„ฑ๋Šฅ ์ €ํ•˜๊ฐ€ ๊ด€์ฐฐ๋˜์—ˆ๋‹ค. ํŠนํžˆ ๊ท ์—ด์€ Dice๊ฐ€ 0.70์—์„œ 0.36์œผ๋กœ ํฌ๊ฒŒ ๊ฐ์†Œํ•˜์—ฌ ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ์ €ํ•˜๋ฅผ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Š” ๊ท ์—ด์ด ๊ฐ€๋Š˜๊ณ  ์„ ํ˜•์ ์ธ ๊ตฌ์กฐ๋ฅผ ๊ฐ€์ง€๋ฉฐ, ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ๋Š” ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ๊ณผ ์ธ์ ‘ํ•˜์—ฌ ๋‚˜ํƒ€๋‚˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์•„ ํด๋ž˜์Šค ๊ฐ„ ๊ฐ„์„ญ๊ณผ ์‹œ๊ฐ์  ํ˜ผ๋™์˜ ์˜ํ–ฅ์„ ํฌ๊ฒŒ ๋ฐ›๊ธฐ ๋•Œ๋ฌธ์œผ๋กœ ํŒ๋‹จ๋œ๋‹ค. ๋ฐ˜๋ฉด ๋ฐ•๋ฝ์€ Dice๊ฐ€ 0.80์—์„œ 0.79๋กœ ๊ฑฐ์˜ ๋™์ผํ•œ ์ˆ˜์ค€์„ ์œ ์ง€ํ•˜์—ฌ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ๋„ ๋น„๊ต์  ์•ˆ์ •์ ์ธ ๋ถ„ํ•  ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ์ด๋Ÿฌํ•œ ๊ฒฐ๊ณผ๋Š” ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• ์ด ๋‹จ์ผ ์†์ƒ ๊ฒ€์ถœ๋ณด๋‹ค ๋†’์€ ๋‚œ์ด๋„๋ฅผ ๊ฐ€์ง€๋Š” ๋ฌธ์ œ์ž„์„ ๋ณด์—ฌ์ค€๋‹ค. ๊ทธ๋Ÿผ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ  ์ œ์•ˆ ๋ชจ๋ธ์€ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ Fine-Tuning๊ณผ ํด๋ž˜์Šค๋ณ„ Threshold Optimization์„ ํ†ตํ•ด ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ๋Šฅ๋ ฅ์„ ํ–ฅ์ƒ์‹œ์ผฐ์œผ๋ฉฐ, ํŠนํžˆ ๋ฐ•๋ฝ๊ณผ ์ฒ ๊ทผ๋…ธ์ถœ์—์„œ๋Š” ๋น„๊ต์  ์•ˆ์ •์ ์ธ ์„ฑ๋Šฅ์„ ์œ ์ง€ํ•  ์ˆ˜ ์žˆ์Œ์„ ํ™•์ธํ•˜์˜€๋‹ค.

Table 12. Comparison between Single-Damage and Composite-Damage Performance

Damage Type Single-Damage Dice Composite-Damage Dice (Fine-tuning + Threshold) Difference (%)
Crack 0.70 0.36 -48.6
Rebar Exposure 0.82 0.60 -26.8
Spalling 0.80 0.79 -1.30

5. Conclusion

๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ์ฒ ๊ทผ์ฝ˜ํฌ๋ฆฌํŠธ ๊ตฌ์กฐ๋ฌผ์˜ ๋Œ€ํ‘œ์ ์ธ ํ‘œ๋ฉด ์†์ƒ์ธ ๊ท ์—ด, ์ฒ ๊ทผ๋…ธ์ถœ ๋ฐ ๋ฐ•๋ฝ์„ ๋™์‹œ์— ๋ถ„ํ• ํ•˜๊ธฐ ์œ„ํ•œ Three-Multihead ๊ธฐ๋ฐ˜ ์˜๋ฏธ๋ก ์  ๋ถ„ํ•  ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ์•ˆํ•˜์˜€๋‹ค. ์ œ์•ˆ ๋ชจ๋ธ์€ ๊ณต์œ  ์ธ์ฝ”๋”์™€ ์†์ƒ๋ณ„ ์ „์šฉ ํ—ค๋“œ๋กœ ๊ตฌ์„ฑ๋˜๋ฉฐ, ๋‹จ์ผ ์†์ƒ Teacher ๋ชจ๋ธ์˜ ์ง€์‹์„ ํ™œ์šฉํ•˜๊ธฐ ์œ„ํ•œ Knowledge Distillation, ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด๋ฅผ ๋ฐ˜์˜ํ•˜๊ธฐ ์œ„ํ•œ Pairwise Prior, ๊ทธ๋ฆฌ๊ณ  ์ค‘๋ณต ํ™œ์„ฑํ™”๋ฅผ ์–ต์ œํ•˜๊ธฐ ์œ„ํ•œ Extra Loss๋ฅผ ํ†ตํ•ฉ์ ์œผ๋กœ ์ ์šฉํ•˜์˜€๋‹ค.

์‹คํ—˜ ๊ฒฐ๊ณผ, ์ œ์•ˆ ๋ชจ๋ธ์€ Baseline ๋ชจ๋ธ ๋Œ€๋น„ ํ‰๊ท  Dice score๋ฅผ 0.37์—์„œ 0.42๋กœ ํ–ฅ์ƒ์‹œ์ผœ ์•ฝ 13.5 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๋‚˜ํƒ€๋ƒˆ๋‹ค. ๋˜ํ•œ Multi-Damage Representation ๋ชจ๋ธ๊ณผ ๋น„๊ตํ•˜์—ฌ ํ‰๊ท  Dice ๊ธฐ์ค€ ์•ฝ 20.0 %์˜ ์ƒ๋Œ€์  ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ๊ธฐ๋กํ•˜์˜€์œผ๋ฉฐ, ์ •์„ฑ์  ๋น„๊ต ๊ฒฐ๊ณผ์—์„œ๋„ ์‹ค์ œ ์†์ƒ๊ณผ ๋ฌด๊ด€ํ•œ ํด๋ž˜์Šค ํ™œ์„ฑํ™”๊ฐ€ ๊ฐ์†Œํ•˜๊ณ  ๋ณด๋‹ค ์•ˆ์ •์ ์ธ ๋ถ„ํ•  ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•จ์„ ํ™•์ธํ•˜์˜€๋‹ค.

Ablation Study ๊ฒฐ๊ณผ Pairwise Prior์™€ Extra Loss๋ฅผ ์ œ๊ฑฐํ•  ๊ฒฝ์šฐ ํ‰๊ท  Dice๊ฐ€ ๋ชจ๋‘ 0.37 ์ˆ˜์ค€์œผ๋กœ ๊ฐ์†Œํ•˜์˜€์œผ๋ฉฐ, ํŠนํžˆ ๋ฐ•๋ฝ ํด๋ž˜์Šค์—์„œ ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ์ €ํ•˜๊ฐ€ ๋‚˜ํƒ€๋‚ฌ๋‹ค. ์ด๋Š” ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด์˜ ๋ฐ˜์˜๊ณผ ์ค‘๋ณต ํ™œ์„ฑํ™” ์–ต์ œ๊ฐ€ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ์ค‘์š”ํ•œ ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•จ์„ ๋ณด์—ฌ์ค€๋‹ค.

๋˜ํ•œ ์‹ค์ œ ๊ตฌ์กฐ๋ฌผ์—์„œ ์ˆ˜์ง‘ํ•œ 44์žฅ์˜ ๋ณตํ•ฉ ์†์ƒ ์ด๋ฏธ์ง€๋ฅผ ์ด์šฉํ•˜์—ฌ ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ์˜ ์„ฑ๋Šฅ์„ ํ‰๊ฐ€ํ•˜์˜€๋‹ค. ์ถ”๊ฐ€ ํ•™์Šต ์—†์ด ์ ์šฉํ•œ ๊ฒฝ์šฐ ํ‰๊ท  Dice๋Š” 0.35๋ฅผ ๊ธฐ๋กํ•˜์˜€์œผ๋ฉฐ, ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ Fine-Tuning ์ดํ›„ 0.57๋กœ ํ–ฅ์ƒ๋˜์—ˆ๋‹ค. ์ดํ›„ ํด๋ž˜์Šค๋ณ„ Threshold Optimization์„ ์ ์šฉํ•œ ๊ฒฐ๊ณผ ํ‰๊ท  Dice๋Š” 0.58์„ ๊ธฐ๋กํ•˜์˜€๋‹ค. Threshold Optimization์— ๋”ฐ๋ฅธ ์ „์ฒด ํ‰๊ท  ์„ฑ๋Šฅ์˜ ์ถ”๊ฐ€ ํ–ฅ์ƒ ํญ์€ ์ œํ•œ์ ์ด์—ˆ์œผ๋‚˜, ํด๋ž˜์Šค๋ณ„ ์ถœ๋ ฅ ํ™•๋ฅ ์˜ ์ฐจ์ด๋ฅผ ๋ณด์ •ํ•˜๊ณ  Precision๊ณผ Recall์˜ ๊ท ํ˜•์„ ์กฐ์ •ํ•˜๋Š” ํšจ๊ณผ๊ฐ€ ํ™•์ธ๋˜์—ˆ๋‹ค. ํŠนํžˆ ๊ท ์—ด ํด๋ž˜์Šค์—์„œ๋Š” Fine-Tuning์„ ํ†ตํ•ด ๊ฐ€์žฅ ํฐ ์„ฑ๋Šฅ ๊ฐœ์„ ์ด ๋‚˜ํƒ€๋‚˜ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ํ•™์Šต์˜ ํšจ๊ณผ๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ๋‹ค.

๋‹จ์ผ ์†์ƒ ํ™˜๊ฒฝ๊ณผ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์„ ๋น„๊ตํ•œ ๊ฒฐ๊ณผ, ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ• ์€ ์†์ƒ ๊ฐ„ ์‹œ๊ฐ์  ๊ฐ„์„ญ๊ณผ ๊ณต๊ฐ„์  ์ธ์ ‘์„ฑ์œผ๋กœ ์ธํ•ด ์—ฌ์ „ํžˆ ๋†’์€ ๋‚œ์ด๋„๋ฅผ ๊ฐ€์ง€๋Š” ๊ฒƒ์œผ๋กœ ๋‚˜ํƒ€๋‚ฌ๋‹ค. ๊ทธ๋Ÿผ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ  ์ œ์•ˆ ๋ชจ๋ธ์€ ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ์…‹์„ ์ด์šฉํ•œ Fine-Tuning์„ ํ†ตํ•ด ์„ฑ๋Šฅ ํ–ฅ์ƒ ๊ฐ€๋Šฅ์„ฑ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์œผ๋ฉฐ, ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ํ•™์Šต์˜ ์ค‘์š”์„ฑ์„ ํ™•์ธํ•˜์˜€๋‹ค.

ํ–ฅํ›„ ์—ฐ๊ตฌ์—์„œ๋Š” ๋ณด๋‹ค ๋‹ค์–‘ํ•œ ๋ณตํ•ฉ ์†์ƒ ์‚ฌ๋ก€๋ฅผ ํฌํ•จํ•˜๋Š” ๋Œ€๊ทœ๋ชจ ๋ฐ์ดํ„ฐ์…‹์„ ๊ตฌ์ถ•ํ•˜๊ณ , ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ํŠนํ™”๋œ ํ•™์Šต ์ „๋žต์„ ์ ์šฉํ•จ์œผ๋กœ์จ ์‹ค์ œ ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ์ ์‘ ์„ฑ๋Šฅ์„ ๋”์šฑ ํ–ฅ์ƒ์‹œํ‚ฌ ํ•„์š”๊ฐ€ ์žˆ๋‹ค. ๋˜ํ•œ ๋ณตํ•ฉ ์†์ƒ ๋ฐ์ดํ„ฐ๊ฐ€ ์ถฉ๋ถ„ํžˆ ํ™•๋ณด๋  ๊ฒฝ์šฐ ๋ณตํ•ฉ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ๊ณผ ๋‹จ์ผ ์†์ƒ ๋ถ„ํ•  ์„ฑ๋Šฅ ๊ฐ„์˜ ๊ฒฉ์ฐจ๋ฅผ ์ค„์ผ ์ˆ˜ ์žˆ์„ ๊ฒƒ์œผ๋กœ ๊ธฐ๋Œ€๋œ๋‹ค. ๋ณธ ์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋Š” ๋ณตํ•ฉ ์†์ƒ ํ™˜๊ฒฝ์—์„œ ์†์ƒ ํด๋ž˜์Šค ๊ฐ„ ๊ณต๊ฐ„์  ์ƒํ˜ธ์ž‘์šฉ ์ •๋ณด์˜ ๋ฐ˜์˜๊ณผ ์ค‘๋ณต ํ™œ์„ฑํ™” ์–ต์ œ๊ฐ€ ์ค‘์š”ํ•œ ์„ค๊ณ„ ์š”์†Œ์ž„์„ ์‹œ์‚ฌํ•œ๋‹ค.

References

1
AI-Hub (2024). National Information Society Agency (NIA), Republic of Korea.Google Search
2
Bai, Y., Sezen, H., Yilmaz, A. (2021). Detecting cracks and spalling automatically in extreme event reconnaissance, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2-2021, 161-168.DOI
3
Caruana, R. (1997). Multitask learning, Machine Learning, 28(1), 41-75.DOI
4
Cha, Y. J., Choi, W., Bรผyรผkรถztรผrk, O. (2017). Deep learning-based crack damage detection using convolutional neural networks, Computer-Aided Civil and Infrastructure Engineering, 32(5), 361-378.DOI
5
Chen, L. C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation, Proceedings of the European Conference on Computer Vision (ECCV), 801-818.DOI
6
Crawshaw, M. (2020). Multi-task learning with deep neural networks: A survey.Google Search
7
Ding, C., Lu, Z., Wang, S., Cheng, R., Boddeti, V. N. (2023). Mitigating task interference in multi-task learning via explicit task routing with non-learnable primitives, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 7756-7765.DOI
8
Dorafshan, S., Thomas, R. J., Maguire, M. (2018). Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete, Construction and Building Materials, 186, 1031-1045.DOI
9
He, K., Zhang, X., Ren, S., Sun, J. (2016). Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770-778.DOI
10
Hinton, G., Vinyals, O., Dean, J. (2015). Distilling the knowledge in a neural network.Google Search
11
Kendall, A., Gal, Y., Cipolla, R. (2018). Multi-task learning using uncertainty to weigh losses for scene geometry and semantics, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 7482-7491.DOI
12
Kim, B., Cho, S. (2020). Automated multiple concrete damage detection using instance segmentation deep learning model, Applied Sciences, 10(22).DOI
13
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., Bengio, Y. (2015). FitNets: Hints for thin deep nets, Proceedings of the International Conference on Learning Representations (ICLR).DOI
14
Ronneberger, O., Fischer, P., Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation, Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 234-241.DOI
15
Vandenhende, S., Georgoulis, S., Van Gool, L. (2020). Multi-scale task interaction networks for multi-task learning, Proceedings of the European Conference on Computer Vision (ECCV).DOI
16
Yang, X., Li, H., Yu, Y., Luo, X., Huang, T., Yang, X. (2018). Automatic pixel-level crack detection and measurement using fully convolutional network, Computer-Aided Civil and Infrastructure Engineering, 33(12), 1090-1109.DOI
17
Zhang, L., Yang, F., Zhang, Y. D., Zhu, Y. J. (2016). Road crack detection using deep convolutional neural network, Proceedings of the IEEE International Conference on Image Processing (ICIP), 3708-3712.DOI
18
Zou, Q., Zhang, Z., Li, Q., Qi, X., Wang, Q., Wang, S. (2019). DeepCrack: Learning hierarchical convolutional features for crack detection, IEEE Transactions on Image Processing, 28(3), 1498-1512.DOI