Suggested CNN Frameworks for Object Detection in Satellite Imagery?

Question

I'm looking to detect boats in large satellite scenes of the ocean. I'm successfully applied matterport's Mask-RCNN setup on small subsets of satellite imagery but it is way too slow to analyze huge images like WorldView. I'm looking for something fast that can do bounding boxes, is in python, implemented in Keras, and ideally optimized (or well documented so I can optimize it) for satellite imagery. Any suggestions?

I've found a couple promising leads:

You Only Look Twice, YOLO variant optimized for satellite imagery but built in C and not super well documented
- Code: https://github.com/avanetten/yolt
- Paper: https://arxiv.org/pdf/1805.09512.pdf
RasterVision: a general python based framework for applying CNNs to satellite imagery, looks promising but nascent
- Code: https://github.com/azavea/raster-vision
This Kaggle competition has some promising info but at ~18 months old is somewhat outdated:
- Link: https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection

I may try to customize this implementation of RetinaNet in Keras for satellite imagery following the suggestions from the YOLT paper but would love other suggestions!

score 1 · Answer 1 · edited Mar 30 '21 at 15:53

1

I found this link by Marc Belmont utilising Tensorflow, Numpy and Pandas: https://github.com/marcbelmont/satellite-image-object-detection

edited Mar 30 '21 at 15:53

desertnaut

57,590
26
140
166

answered Nov 08 '18 at 16:03

Thirst for Knowledge

1,606
2
26
43

1

Hi @Thirst I ended up using https://github.com/fizyr/keras-retinanet which I highly recommend as both well documented and very good at object detection. Just had to add some tweaks for the hyperparameters and some ingest and output scripts to work with geospatial data. – clifgray Nov 08 '18 at 20:11

score 1 · Accepted Answer · answered Apr 28 '21 at 15:12

This question is now long unanswered so I thought I'd answer with my solution. I implemented retinanet for a number of satellite detection problems with good results. This CNN is outlined in the paper Focal Loss for Dense Object Detection which you can find here: https://arxiv.org/abs/1708.02002. I used this keras library for implementation: https://github.com/fizyr/keras-retinanet.

I've used it to detect seals in drone imagery: https://bigdata.duke.edu/projects/deep-learning-aerial-wildlife-surveillance

Birds in drone imagery: https://research.repository.duke.edu/concern/datasets/kp78gh20s

And even whales in satellite imagery. All of which it did well with minimal adjustment.

Suggested CNN Frameworks for Object Detection in Satellite Imagery?

2 Answers2