Mask R-CNNを実装してみました

Chainer LT Meetup #1

1. Mask R-CNN›î÷`oˆ‡`h
@tkato_

2. ×~ ºp
•C{)Õ¢TqOom–O£
•Twitter: @tkato_
•½”ÜåØÒÜqþ https://www.teamlab.art/
•Ã´»çž”ÄtSZ”hþ·ï³ï¬›`oM‡b
•µ¯wK”üúú.U Z~Ù”¶*~Äå¿©ï¬

3. Mask R-CNN›î÷`oˆ‡`h
“Äpx®ú.U Zs’TensorflowwAPIp¯èÕç
p )‡”\q‹Mwpz曡ˆz6qî÷›`
oˆ”\qp¤ï´Çž—›K[‘OqMO¼ˆ
https://github.com/katotetsuro/chainer-maskrcnn

4. Mask R-CNN
Task:Instance Segmentation, Keypoint detection

5. î÷M
chainercvwFaster-RCNNwî÷›Õ”µt
Segmentation Mask›*b”branch›XlmZ”
DeNA^œq‰aMpbzGMt€ßt^doÖV‡`h
(https://engineer.dena.jp/2017/12/chainercvmask-r-cnn.html)

6. î÷`h漃: Feature Pyramid Network
•DeepprþSw –^M›ÃÚ¿Ó›Upsamplingb”\qp –
^Mú.t0b”U ZQó› Í[”
•Chainer›–Qyot {Z”

7. î÷`h漄: RoI Align
{± ¶w›ÃڿӁCrop & Resizeb”

8. RoI Alignî÷p>›mZh\q
•chainerwROIPooling2D›€ßtb”¢ÂµÄ‹‰£
•ÂµÄU蔑Otî÷b”
•forwardw-‰ALU cpuqgpups`M
•backwardw-‰ALU:‹üqs`M
•Caffe2wRoIAlignqforwardw-‰ALU‰a\q›¬Ýb”
•CuPywElementwiseKernel›–Qyot {Z”

9. ALƒ: segmentation

10. AL„: Keypoint Detection

11. ™“hM\q
•Kinect V2™' êMT’wd Z
•ÃÌ µqSDKw1“T’rL^•hM
•Depth or IRhþÖ—t0b”User Segmentationq
Keypoint Detection
•>†Mask RCNNwž”©Â«½ß›0”=`h[p
pV”

12. 4:Mask RCNNî÷
¬ÜŠzhX^œwî÷UK“‡b‚
https://github.com/facebookresearch/Detectron
https://github.com/tensorflow/models/blob/master/research/
object_detection/g3doc/instance_segmentation.md
https://github.com/matterport/Mask_RCNN
https://github.com/DeNA/Chainer_Mask_R-CNN
https://github.com/TuSimple/mx-maskrcnn

13. Mask RCNNr†
http://deeplearning.csail.mit.edu/instance_ross.pdf
RoI Alignr† ®7 ýwú.U Z OMask R-CNNwRoI AlignqFast(er) R-CNNwRoI Poolingw§M›Y`Xgrb”¯
https://qiita.com/yu4u/items/5cbe9db166a5d72f9eb8
Keynote template
http://sanographix.github.io/azusa-colors/