EE/KN: Reusable Audio Augmentation (SpecAugment) Framework for the Training Pipeline - #975
EE/KN: Reusable Audio Augmentation (SpecAugment) Framework for the Training Pipeline#975KCP17 wants to merge 7 commits into
Conversation
… and experiment results
Mangon3
left a comment
There was a problem hiding this comment.
The SpecAugment work, visualisations, and the three-arm validation experiment are good. One small problem on merging (not your code):
Since this branch was opened, #976 merged into main and it also landed the augmentation/ pipeline, including a different version of augment.py and the shared main.py/train.py/dataset.py. So this PR is currently conflicting.
Could you rebase onto current main and scope this PR down to just your additions:
augment.py(see note below)visualise_spec_augment.py,run_validation_experiment.py,build_experiment_subset.pyspectrogram_examples/
and also drop the pipeline files already in main (main.py, train.py, dataset.py, model/, config/model|teacher_model/) so the diff is only your work?
Two more things:
augment.pymain already has #976's rewrite and yours is different. Please apply your changes on top of the current one or message me to discuss which to keep.- Please drop the committed artifacts: the
experiment_results/tfeventsfiles andtrain_log.txts (and ideally the large PNGs). A short summary in the README/report is enough.
Not approving yet because of the conflict + overlap. The work is good. Ping me once it's rebased and I'll re-review.
Summary
This pull request contains all the deliverables for my Sprint 1 task: Reusable Audio Augmentation (SpecAugment) Framework for the Training Pipeline. It also consists of the other files from last trimester needed to run the experiments.
What changed
All are added to
src/prototypes/engine/augmentation/augment.py: an improvedSpecAugment(improved from the original one from last trimester)config/config.yamlandconfig/augmentation/*.yaml: augmentation configuration options.config/local/cpu.yaml: bundle file to fix environmental gaps.README.md: full usage instructions to run augmentation (modified from the old placeholder file).visualise_spec_augment.pyandspectrogram_examples/*.png: before-and-after spectrogram examples (PNG files), generated by the associated code file.build_experiment_subset.py,run_validation_experiment.py, andexperiment_results/{none,original_unfixed,default}/: a three-armvalidation experiment (no augmentation, original unfixed settings, and fixed
default settings) confirming augmented training data remains valid.
main.py,train.py,dataset.py,model/,config/{model,teacher_model}/*.yaml- existing training pipelineSpecAugmentplugs into. Not authored or modified this sprint, included because the framework above isn't runnable without them.Checklist
augment.pyreviewed and augmentation connects to the training dataloader confirmed - inReview of current SpecAugment implementation and its connection to the training dataloader.pdfuploaded to MS TeamsProject - Project Echo/T2 2026/Sprint 1/Engine/Kiernanfolder.augment.py)config/augmentation/*,README.md)spectrogram_examples/,visualise_spec_augment.py)Spectrogram Comparison Examples.pdfexperiment_results/,run_validation_experiment.py)Validation Experiment.pdfSprint 2 Plan.pdfProject_Echo_Sprint1_Augmentation_Framework_Report.pdf