add ssd estimator #1394
Merged
add ssd estimator #1394
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chongruo
reviewed
Aug 3, 2020
gluoncv/auto/estimators/ssd/ssd.py
Outdated
Comment on lines
12
to
25
| import gluoncv as gcv | ||
|
|
||
| from gluoncv import data as gdata | ||
| from gluoncv import utils as gutils | ||
| from gluoncv.model_zoo import get_model | ||
| from gluoncv.data.batchify import Tuple, Stack, Pad | ||
| from gluoncv.data.transforms import presets | ||
| from gluoncv.data.transforms.presets.ssd import SSDDefaultTrainTransform | ||
| from gluoncv.data.transforms.presets.ssd import SSDDefaultValTransform | ||
| from gluoncv.data.transforms.presets.ssd import SSDDALIPipeline | ||
| from gluoncv.nn.bbox import BBoxClipToImage | ||
| from gluoncv.utils.metrics.voc_detection import VOC07MApMetric | ||
| from gluoncv.utils.metrics.coco_detection import COCODetectionMetric | ||
| from gluoncv.utils.metrics.accuracy import Accuracy |
There was a problem hiding this comment.
should use relative imports as estimators/ is under the gluoncv folder.
Eg. from ...model_zoo import get_model
There was a problem hiding this comment.
we should use relative import here
chongruo
reviewed
Aug 3, 2020
gluoncv/auto/estimators/ssd/utils.py
Outdated
Comment on lines
7
to
15
| from gluoncv import data as gdata | ||
| from gluoncv.data.batchify import Tuple, Stack, Pad | ||
| from gluoncv.data.sampler import SplitSortedBucketSampler | ||
| from gluoncv.data.transforms.presets.ssd import SSDDefaultTrainTransform | ||
| from gluoncv.data.transforms.presets.ssd import SSDDefaultValTransform | ||
| from gluoncv.data.transforms.presets.ssd import SSDDALIPipeline | ||
| from gluoncv.utils.metrics.voc_detection import VOC07MApMetric | ||
| from gluoncv.utils.metrics.coco_detection import COCODetectionMetric | ||
| from gluoncv.utils.metrics.accuracy import Accuracy |
chongruo
reviewed
Aug 3, 2020
gluoncv/auto/estimators/ssd/utils.py
Outdated
| skip_empty=False) | ||
| val_metric = COCODetectionMetric( | ||
| val_dataset, os.path.join(args.logdir, args.save_prefix + '_eval'), cleanup=True, | ||
| data_shape=(args.data_shape, args.data_shape)) |
There was a problem hiding this comment.
Thx Chongruo, the problems have been corrected.
zhreshold
reviewed
Aug 5, 2020
|
|
||
|
|
||
| @ex.config | ||
| def default_configs(): |
There was a problem hiding this comment.
as discussed offline, we can use get_ssd function and expose more options to customize the network structure here
zhreshold
reviewed
Aug 14, 2020
scripts/detection/ssd/fit_ssd.py
Outdated
|
|
||
| import gluoncv as gcv | ||
|
|
||
| gcv.utils.check_version('0.7.0') |
zhreshold
reviewed
Aug 14, 2020
gluoncv/model_zoo/model_zoo.py
Outdated
| @@ -127,6 +127,7 @@ | |||
| 'ssd_300_mobilenet0.25_voc': ssd_300_mobilenet0_25_voc, | |||
| 'ssd_300_mobilenet0.25_coco': ssd_300_mobilenet0_25_coco, | |||
| 'ssd_300_mobilenet0.25_custom': ssd_300_mobilenet0_25_custom, | |||
| 'custom_ssd': custom_ssd, | |||
There was a problem hiding this comment.
this is not necessary in model_zoo
zhreshold
approved these changes
Aug 14, 2020
zhreshold
added a commit
that referenced
this pull request
Nov 2, 2020
* [WIP] Fit api with sacred config (#1331) * config using sacred * update * update base * allow attribute access, add warning to config modification (#1348) * Faster R-CNN estimator (#1338) * move rcnn forward backward task to model zoo * revert #1249 * fix * fix * docstring * fix style * add docs * faster rcnn estimator * refactor * move dataset to init * lint * merge * disable sacred config for now * logger fix * fix fit * update full centernet example (#1349) * Autogluon Integration (#1355) * move rcnn forward backward task to model zoo * revert #1249 * fix * fix * docstring * fix style * add docs * faster rcnn estimator * refactor * move dataset to init * lint * merge * disable sacred config for now * logger fix * fix fit * autogluon integration * fix small bug. training working * lint * sacred config for faster rcnn (#1358) * move rcnn forward backward task to model zoo * revert #1249 * fix * fix * docstring * fix style * add docs * faster rcnn estimator * refactor * move dataset to init * lint * merge * disable sacred config for now * logger fix * fix fit * autogluon integration * fix small bug. training working * lint * sacred config for faster rcnn * Finish centernet fit estimator (#1359) * add voc detection pipeline * update * fix errors * Add docs for Faster R-CNN config (#1361) * move rcnn forward backward task to model zoo * revert #1249 * fix * fix * docstring * fix style * add docs * faster rcnn estimator * refactor * move dataset to init * lint * merge * disable sacred config for now * logger fix * fix fit * autogluon integration * fix small bug. training working * lint * sacred config for faster rcnn * add config docs * Estimator rcnn (#1366) * move rcnn forward backward task to model zoo * revert #1249 * fix * fix * docstring * fix style * add docs * faster rcnn estimator * refactor * move dataset to init * lint * merge * disable sacred config for now * logger fix * fix fit * autogluon integration * fix small bug. training working * lint * sacred config for faster rcnn * add config docs * move all logging into base estimator logdir * raise key error when config is not found in freezed config (#1367) * auto object detection refactor (#1371) * auto object detection refactor * change logdir and common config * centernet config change * autogluon * fix auto object detection task * add mask_rcnn estimator (#1398) * fix typo (#1378) Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-100.us-west-2.compute.internal> * add ssd estimator (#1394) * add ssd estimator * modify ssd estimator * provide options to customize network structure * minor changes * minor changes * add auto detection using ssd * add auto detection using ssd * add custom model for ssd * minor changes * add tiny dataset for testing; fix errors in training auto detector * [WIP] Add estimator(yolo) (#1380) * yolo * yolo * add yolo * [chore] update name, add fit script Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-100.us-west-2.compute.internal> * auto register args (#1419) * Auto detector (#1425) * auto detector * auto detector * auto detector * auto detector * auto detector * auto detector Co-authored-by: Joshua Z. Zhang <cheungchih@gmail.com> * update auto detection (#1436) * auto detector * auto detector * auto detector * auto detector * auto detector * auto detector * update auto detection * add a framework for automatic suggestion of hyperparameter search space * 1) change auto_resume default to False; 2) change input config to estimator is a pure dict * [fix] bugs for test_auto_detection (#1438) Co-authored-by: Ubuntu <ubuntu@ip-172-31-31-97.us-west-2.compute.internal> * add cls (#1381) * update auto suggest (#1443) * update auto suggest * update auto suggest * fix yolo errors (#1445) * remove dependencies on AutoGluon non-core functions (#1452) * remove dependency to autogluon non-core functions * fix errors on importing estimators * [Lint] fix pylint for estimator branch (#1451) * fix pylint * update mxnet build * remove py2 * remove py2.yml * fix jenkinsfile * fix post_nms in rcnn * fix * fix doc build * fix lint con't * add sacred * no tutorial yet * estimator prototype for save/load (#1458) * prototype for save/load * add type check * handle ctx * fix * collect * fix classmethod self * fix * pickle only init args * cast to numpy to avoid ctypes * fix get data * base estimator * [WIP] Add detailed logging information for auto estimator (#1470) * add detailed logging information for auto estimator * fix lint error * [WIP] Estimator data (#1471) * dataframe for object detection * fix pack and unpack for bboxes * update * refactor fit * fix * update pickle behavior * update * fix __all__ * Dataset as class property not module * fix centernet, add image classification dataset * fix * fix * fix logger not inited before init_network * reuse weights from known classes * add predict * fix index * format returned prediction * fix id to int * improve predict with pd.dataframe * add numpy * reset index * clean up * update image classification dataset * dataset improvements * valid url checker * setup.py improve * fix * fix import utils * add display to object detection * fix * change fit functions * add coco import * fix lint * fix lint * fix lint * fix * Estimator con't improvements (#1484) * allow ssd/faster-rcnn to take in train/val dataset * update * fix * update ssd * fix ctx * fix ctx * fix self.datasets * fix self.epoch * remove async_net * fix predict * debug predict * fix predict scores * filter out invalid predictions * fix faster_rcnn * fix * fix * fix deepcopy * fix fpn anchor generator * fix ctx * fix frcnn predict * fix * fix skipping logic * fix yolo3 * fix import * fix rename yoloestimator * fix import * fix yolo3 train * fix * fix * fix * fix * fix * fix * fix * fix ctx * fix trainer * fix num_class < 5 for topk * fix unpickable batch_fn * fix print * add predict * fix cls predict * fix cls predict * fix cls predict * fix cls predict * improve auto fit * improve auto fit * fix * fix * fix * fix * fix * debug * fix * fix * fix * fix * fix * fix * fix reporter pickle * change epochs to smaller * update image cls search space * fix * fix * fix * fix * fix * fix * fix * replace sacred with autocfg * fix * fix tuple type * fix * fix * fix * clean up * remove sacred * fix import * fix import * add types * fix * fix * defaults for object detection * fix * fix * update image classification * change lr * update * Fix pylint * Fix pylint * fit summary * pprint summary * fix * update * fix single trial * fix sample_config * fix sample_config * fix sample_config * fix lint * fix lint * adjust batch size * fix * stacktrace * fix * fix traceback * fix traceback * fix train evaluation * default networks * default networks * improves * fix * fix lint Co-authored-by: tmwangcas <tmwang428@outlook.com> * update script to master * add unittests for auto * update conda * pin autogluon * fix test * fix * fix ssd/yolo * fix * update defaults * fix kv_store being overwriten * fix rcnn batch size Co-authored-by: Jerry Zhang <zhangz6@cs.washington.edu> Co-authored-by: Tianming Wang <tmwang428@outlook.com> Co-authored-by: Chongruo Wu <chongruo@gmail.com> Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-100.us-west-2.compute.internal> Co-authored-by: Ubuntu <ubuntu@ip-172-31-31-97.us-west-2.compute.internal>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.