3D勉強会発表資料 (q_tarou)

Monocular Total Capture: Posing Face, Body, and Hands in the Wild (arXiv)

1. Hs%)§qC¯¿‰
.POPDVMBS5PUBM$BQUVSF
1PTJOH'BDF#PEZBOE)BOETJOUIF8JME
JER@UBSPV

2. s ºpb”æ
.POPDVMBS5PUBM$BQUVSF
1PTJOH'BDF#PEZBOE)BOETJOUIF8JME
%POHMBJ9JBOH)BOCZVM+PP:BTFS4IFJLI$.6BS9JW 4VCNJUUFEPO%FD
5PUBM$BQUVSF
"%%FGPSNBUJPO.PEFMGPS5SBDLJOH'BDFT)BOETBOE#PEJFT
)BOCZVM+PP5PNBT4JNPO:BTFS4IFJLI$.6$713 #FTUTUVEFOUQBQFSBXBSE
¹:éþT’ƒø.›
%EFGPSNBCMFNPEFMq`o©ßÓ½ßb”
oéþT’%UPUBMNPUJPO
%EFGPSNBCMFNPEFM›*b”

3. (Š
5PUBM$BQUVSF
"%%FGPSNBUJPO.PEFMGPS5SBDLJOH'BDFT)BOETBOE#PEJFT
)BOCZVM+PP5PNBT4JNPO:BTFS4IFJLI$.6$713 #FTUTUVEFOUQBQFSBXBSE
5PUBM$BQUVSF
%)VNBO1PTF&TUJNBUJPO'VTJOH7JEFPBOE*OFSUJBM4FOTPST
.BUUIFX5SVNCMF"OESFX(JMCFSU$IBSMFT.BMMFTPO"ESJBO)JMUPOBOE+PIO$PMMPNPTTF
4VSSZ6OJWFSTJUZ#.7$

4. 5PUBM$BQUVSF
"%%FGPSNBUJPO.PEFMGPS
5SBDLJOH'BDFT)BOETBOE#PEJFT
)BOCZVM+PP5PNBT4JNPO:BTFS4IFJLI$.6$713

5. *OUSPEVDUJPO
w¹”³ßç¯ÛáÇ­”³ãï›gr`hM}
¯ ؍´£µ½ßt OAs ØCU‡•”U|
\•’›wù$tÚ”§”èµp{O³µÂÜxÁM}

¹:éþ›Ö—q`o|.w¶æ¢#PEZ'BDF)BOE£
›wù$t{O%NPEFM›îib”}
è$
ITM¦wˆV¯ ؇p{MhM
¤æwµ­”çUŸs”wp|
¤æt“po’•hhþwrþSUGVXŸs”
ðJ

6. Owv•
Ö—
.VMUJWJFXWJEFPT
Z—
%NPEFMJOFBDIGSBNF
HFOFSBUJWF%UFNQMBUFNPEFM
pUUJOH
$POUSJCVUJPO
b‚ow搛wù
$t{O%ÞÃç›
¨Š
$POUSJCVUJPO
ó:w*|¦«ç”´ãïté̵ÄsÑŸ¿ÂŸï¬

7. .PEFM'SBOL
#PEZ<>POMZ 'BDF<>)BOET
¯ ØU¯q
pVoMsM
msWèUèqm
CMFOEJOH
'BDF)BOE
ÞÃ盋Ö
<>-PQFS.BUUIFXFUBM4.1-"TLJOOFENVMUJQFSTPOMJOFBSNPEFM"$.50(
<>$BP$IFOFUBM'BDFXBSFIPVTF"EGBDJBMFYQSFTTJPOEBUBCBTFGPSWJTVBM
DPNQVUJOH*&&&57$(
'SBOLNPEFM
NPUJPOTIBQF
HMPCBM
USBOTMBUJPO

8. .PEFM'SBOL #PEZ
#PEZ<>POMZ
<>-PQFS.BUUIFXFUBM4.1-"TLJOOFENVMUJQFSTPOMJOFBSNPEFM"$.50(
#PEZwÝ¿³á
NPUJPOTIBQF
HMPCBM
USBOTMBUJPO

9. .PEFM'SBOL 'BDF)BOET
'BDF<>)BOET
<>$BP$IFOFUBM'BDFXBSFIPVTF"EGBDJBMFYQSFTTJPOEBUBCBTFGPSWJTVBM
DPNQVUJOH*&&&57$(
'BDFwÝ¿³á
)BOEwÝ¿³á
Aù [xNBOVBMMZ

10. .PEFM'SBOL
'BDF<>)BOET'SBOLNPEFM
msWèUèqm
CMFOEJOH

11. Owv• 6
Ö—
.VMUJWJFXWJEFPT
Z—
%NPEFMJOFBDIGSBNF
HFOFSBUJWF%UFNQMBUFNPEFM
pUUJOH
$POUSJCVUJPO
b‚ow搛wù
$t{O%ÞÃç›
¨Š
$POUSJCVUJPO
ó:w*|¦«ç”´ãïté̵ÄsÑŸ¿ÂŸï¬

12. .PUJPO$BQUVSFXJUI'SBOL.PEFM
¹:éþT’îi`h…”¯Øw:q|
0 b”ÞÃçw:w‘mU7 –ts”‘Ot7&=b”}
M
PCKFDUJWF
GVODUJPO
HR 4.1-srx¶ 6Õ”µ

13. .PUJPO$BQUVSFXJUI'SBOL.PEFM
éþT’îi`h…”¯Øw:q|
0 b”ÞÃçw:w‘mU7 –ts”‘Ot7&=b”}
M
PCKFDUJWF
GVODUJPO
"OBUPNJDBM,FZQPJOU
¹:éþT’U Z`h
LFZQPJOU›USJBOHVMBUJPO
¹:éþT’%îi`h…”q
0 b”ÞÃç:w¡)
ÞÃçtSZ”
…”
éþT’îi
`h…:

14. .PUJPO$BQUVSFXJUI'SBOL.PEFM
éþT’îi`h…”¯Øw:q|
0 b”ÞÃçw:w‘mU7 –ts”‘Ot7&=b”}
M
PCKFDUJWF
GVODUJPO
*$1$PTU
¹:éþT’.74p
îi`h:
¹:éþT’%îi`h:q
0 b”ÞÃç:w¡)
O¢ ÞÃç: .74p
îi`h:

15. .PUJPO$BQUVSFXJUI'SBOL.PEFM
éþT’îi`h…”¯Øw:q|
0 b”ÞÃçw:w‘mU7 –ts”‘Ot7&=b”}
M
PCKFDUJWF
GVODUJPO
¥„–¬pC\b”EJTDPOUJOVJUZw«%JTDPOUJOVJUZt0b”¡)
¥„–¬w
O ú›-‰

16. .PUJPO$BQUVSFXJUI'SBOL.PEFM
éþT’îi`h…”¯Øw:q|
0 b”ÞÃçw:w‘mU7 –ts”‘Ot7&=b”}
M
PCKFDUJWF
GVODUJPO
%,FZQPJOUT.74pîi`h:xÊ ¶›XœpM” ÔùU
K”hŠ|\•’wÊ ¶t0WFSpUUJOH`sM‘Ot&@QSJPS›;M”}

17. Owv• 6
Ö—
.VMUJWJFXWJEFPT
Z—
%NPEFMJOFBDIGSBNF
HFOFSBUJWF%UFNQMBUFNPEFM
pUUJOH
$POUSJCVUJPO
b‚ow搛wù
$t{O%ÞÃç›
¨Š
$POUSJCVUJPO
ó:w*|¦«ç”´ãïté̵ÄsÑŸ¿ÂŸï¬

18. .PEFM"EBN
*OQVU
'SBOLFOTUFSJO "EBN
³ïÓçs
QBSBNFUFSJ[BUJPO
Eð÷›Sé
„wmsWèU
ÁM

19. $SFBUJOH"EBN
'SBOLw\tÔ»·¿Ä
"EBN
.PEFMw,FZQPJOUqéþT’
U Z`h,FZQPJOUwÆ°•›è
EðwHFPNFUSZ›¯qpV”
-#4ݦ 6

20. 3FTVMUT

21. 3FTVMUT

22. ‡qŠ
¹:éþ›Ö—q`o|.w¶æ¢#PEZ'BDF)BOE£
›wù$t{O%NPEFM›îib”}
è$
¤æwµ­”çUŸs”wp|
qètSMo¤æt“po’•hrþSUGVXŸs”
ðJ
ýhs%ÞÃç¢'SBOLFOTUFSJOq"EBN£›Š
¦«ç”´ãïsrt§MLFZQPOUÕ”µw
ÑŸ¿ÂŸï¬MO›Š
éY

23. .POPDVMBS5PUBM$BQUVSF
1PTJOH'BDF#PEZBOE)BOETJOUIF8JME
%POHMBJ9JBOH)BOCZVM+PP:BTFS4IFJLI$.6BS9JW

24. *OUSPEVDUJPO
wæˆ~ˆ^›grb” Íp\•’›©ßÓ½ßb”\q
x OA}°M|¹:§Ýå³µÂÜsr¯µÄUTT”}

oéþJOUIFXJMET’%CPEZ›îib”è$
éþq%CPEZJOUIFXJMEwÖžwÔ»·¿ÄUÁMhŠ|
Ú€éþT’%CPEZ›*b”\qxÉ`M
ðJ

25. Owv•
Ö—
4JOHMFWJFXWJEFP
HFOFSBUJWF%UFNQMBUFNPEFM
10'FTUJNBUJPO
NPEFMpUUJOH
.FTIUSBDLJOH
Z—
%NPEFMJOFBDIGSBNF
$POUSJCVUJPOoéþT’%UPUBMNPUJPO›*b”7 sw O
$POUSJCVUJPO%10'q%LFZQPJOUT›b;`hÞÃçÑŸ¿ÂŸï¬tb”7&= O›Š
$POUSJCVUJPO1IPUPDPOTJTUFODZ›b;`h
NPUJPOKJUUFSwHM
$POUSJCVUJPO
ýÔ»·¿Ä

26. Owv•
Ö—
4JOHMFWJFXWJEFP
Z—
%NPEFMJOFBDIGSBNF
HFOFSBUJWF%UFNQMBUFNPEFM
NPEFMpUUJOH
10'FTUJNBUJPO.FTIUSBDLJOH
$POUSJCVUJPOoéþT’%UPUBMNPUJPO›*b”7 sw O
$POUSJCVUJPO%10'q%LFZQPJOUT›b;`hÞÃçÑŸ¿ÂŸï¬tb”7&= O›Š
$POUSJCVUJPO1IPUPDPOTJTUFODZ›b;`h
NPUJPOKJUUFSwHM
$POUSJCVUJPO
ýÔ»·¿Ä

27. %1BSU0SJFOUBUJPO'JFME
%10'%hþ ÍtSZ”¤…w%PSJFOUBUJPO
1 NOw%PSJFOUBUJPO
%…”
YtSZ”10'
…wÖž
+PJOUDPOpEFODFNBQSq1BSUPSJFOUBUJPOpMFELݦ 6

28. %FGPSNBCMF.FTI.PEFM'JUUJOHXJUI10'T
M
%LFZQPJOUT10'tb”¡)U7 –t
s”‘OtÞÃçÍåÝ”»›7&=

29. %FGPSNBCMF.FTI.PEFM'JUUJOHXJUI10'T

30. Owv•
Ö—
4JOHMFWJFXWJEFP
Z—
%NPEFMJOFBDIGSBNF
HFOFSBUJWF%UFNQMBUFNPEFM
NPEFMpUUJOH
10'FTUJNBUJPO.FTIUSBDLJOH
$POUSJCVUJPOoéþT’%UPUBMNPUJPO›*b”7 sw O
$POUSJCVUJPO%10'q%LFZQPJOUT›b;`hÞÃçÑŸ¿ÂŸï¬tb”7&= O›Š
$POUSJCVUJPO1IPUPDPOTJTUFODZ›b;`h
NPUJPOKJUUFSwHM
$POUSJCVUJPO
ýÔ»·¿Ä

31. &OGPSDJOH1IPUP$POTJTUFODZJO5FYUVSFT
ÑŸ¿Ä`hÝ¿³áÞÃç›hþ Ítdè`|
fw«µ½ßwQIPUPDPOTJTUFODZ›b;b”}
M
JUIGSBNF JUIGSBNF JUIGSBNF SFpOFNFOU
0QUJDBMqPXwEFTUJOBUJPO
3FpOF0 ÅwÝ¿³á

32. 3FTVMUT #PEZQPTF
%BUBTFU)VNBO.
3FTVMUTPOJOUIFXJMEWJEFPT
1SJPS“1SJPSÁ`
°A:.FBO1FS+PJOU1PTJUJPO&SSPS .1+1&
*OUIFXJME³Ææ¦p7ô^S›aR
"EBNp°A

33. 3FTVMUT )BOEQPTF
%BUBTFU4UFSFP)BOE1PTF5SBDLJOH%FYUFSPCKFDU
¤Ã”»·¿Äp7ô^S›aR
'SBOLp°A

34. 3FTVMUT 7JFXBOE1PTFDIBOHFT
%BUBTFU/FXMZ$BQUVSFE5PUBM.PUJPO%BUBTFU
°A:.FBO1FS+PJOU1PTJUJPO&SSPS .1+1&
ô¼¯wqVxTFMGPDVMVTJPOsrp^SUq=b”}
YØtz‚|Øw ÔùxPDVMVTJPOUC`o^SUq=b”}

35. 3FTVMUT .FTI5SBDLJOH
Äå¿©ï¬t‘“^SU² Í`|†`o*pVoM”

36. 3FTVMUT

37. 3FTVMUT

38. ‡qŠ
oéþJOUIFXJMET’%CPEZ›îib”è$
ðJ
oéþT’%UPUBMNPUJPO›*b” sw O›Š
%10'›b;`hÞÃçÑŸ¿ÂŸï¬tb”7&=
O›Š
1IPUPDPOTJTUFODZ›b;`hNPUJPOKJUUFSwHM›îq
ý`MUPUBMNPUJPOEBUBTFU›Š
éY
éþq%CPEZJOUIFXJMEwÖžwÔ»·¿ÄUÁMhŠ|
Ú€éþT’%CPEZ›*b”\qxÉ`M

39. (Š
5PUBM$BQUVSF"%%FGPSNBUJPO.PEFMGPS5SBDLJOH'BDFT)BOETBOE#PEJFT
.POPDVMBS5PUBM$BQUVSF1PTJOH'BDF#PEZBOE)BOETJOUIF8JME
$PODMVTJPOwE˜“t%JTDVTTJPOpŠ”wUÄèïŁ