diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 11701cc..a35c41e 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -34,7 +34,7 @@ jobs: run: | bundle exec htmlproofer ./_site \ --disable-external \ - --ignore-urls "/^http:\/\/127.0.0.1/,/^http:\/\/0.0.0.0/,/^http:\/\/localhost/,/\/fsqc\//,/\/LaPy\//,/\/BrainPrint/,/\/FastSurfer\//" \ + --ignore-urls "/^http:\/\/127.0.0.1/,/^http:\/\/0.0.0.0/,/^http:\/\/localhost/,/\/fsqc\//,/\/LaPy\//,/\/BrainPrint/,/\/FastSurfer\//,/\/neuroreg\//,/\/hipsta\//,/\/WhipperSnapPy\//" \ --allow-hash-href - name: Upload built site diff --git a/_config.yml b/_config.yml index 356dcb0..bff1622 100644 --- a/_config.yml +++ b/_config.yml @@ -4,12 +4,15 @@ description: "This is the official web page for the Deep Medical Imaging Lab at url: "https://Deep-MI.org" paginate: 5 -plugins: [jekyll-paginate] +plugins: [ jekyll-paginate ] paginate_path: "news/page:num" permalink: pretty markdown: kramdown -kramdown: +kramdown: parse_block_html: true -exclude: [vendor] +exclude: + - vendor + - .agentbridge + - .agent-work diff --git a/_data/members.yml b/_data/members.yml index 28f8ca3..8a44249 100644 --- a/_data/members.yml +++ b/_data/members.yml @@ -33,7 +33,7 @@ and structural shape analysis for computer-aided diagnosis and prognosis. His methods are widely employed as part of the open source FreeSurfer software package to study neurodegeneration and assess disease modifying therapies, e.g., by the Alzheimer''s Disease Neuroimaging Initiative, - the Rhineland Study, and other large cohort studies. + the [Rhineland Study](https://www.rheinland-studie.de/en/research/research-areas/), and other large cohort studies. After receiving a competitive NIH Career Award (2014) for his research on computational methods for medical image @@ -51,7 +51,7 @@ github: santiestrada32 description: 'Santiago graduated from Technical University of Munich (TUM) with a degree in Biomedical Computing. His research focuses on the deployment of deep learning methods for - quantifying imaging biomarkers in large cohort studies (e.g. [Rhineland Study](https://www.rheinland-studie.de/)). + quantifying imaging biomarkers in large cohort studies (e.g. [Rhineland Study](https://www.rheinland-studie.de/en/research/research-areas/)). When not at the lab, Santiago enjoys going to the movies and exploring the city.' projects: 'Olfactory Bulb Segmentation, Localized Brain Age Prediction, Automated Tools for Retina Image Analysis' diff --git a/_data/projects.yml b/_data/projects.yml index 3cc94cc..2d07542 100644 --- a/_data/projects.yml +++ b/_data/projects.yml @@ -4,6 +4,7 @@ # name: display name # tag: short category label shown on the card # featured: true → teal top border on card +# homepage: true → shown on the front page (all projects appear on /research/) # description: one or two sentences shown on the card # image: path to card thumbnail (leave blank for a letter placeholder) # url: link for "Learn more" — use a local path or external URL @@ -13,6 +14,7 @@ name: FastSurfer tag: Neuroimaging Pipeline featured: true + homepage: true description: > Fast, accurate, deep-learning pipeline for whole-brain segmentation in under a minute and full surface reconstruction in about an hour. @@ -21,6 +23,42 @@ url: /research/fastsurfer/ github: deep-mi/FastSurfer +- id: neuroreg + name: NeuroReg + tag: Image Registration + homepage: true + description: > + GPU-accelerated Python toolkit for neuroimaging registration — same-modality, + cross-modal, boundary-based, and multi-timepoint — plus transform and volume + utilities. Replaces FreeSurfer's mri_robust_register, mri_coreg, and + bbregister. Usable from the command line or as a library. + image: /static/pub/reuter_2010_invconsregistration.jpg + url: /neuroreg/ + github: deep-mi/neuroreg + +- id: hipsta + name: HipSTA + tag: Shape Analysis + homepage: true + description: > + Automated geometry-based method for hippocampal shape and thickness analysis + from structural MRI, enabling fine-grained morphometric studies of the + hippocampus. + image: /static/pub/diers_2023.jpg + url: /hipsta/ + github: deep-mi/hipsta + +- id: neurocade + name: NeuroCade + tag: Neuroimaging Platform + homepage: true + description: > + AI-powered neuroimaging platform combining an MRI viewer with integrated + pipelines like FastSurfer. Run complex structural imaging workflows through + a GUI or conversational AI — no command line required. + image: /static/img/research/neurocade/teaser.jpg + url: https://neurocade.org + - id: fatsegnet name: FatSegNet tag: MRI Segmentation @@ -45,6 +83,7 @@ - id: p3cnn name: p3CNN tag: Cortical Surface + homepage: true description: > Cortical surface parcellation using projection-based 3D convolutional neural networks operating on spherical mesh representations. @@ -54,6 +93,7 @@ - id: lapy name: LaPy tag: Python Library + homepage: true description: > Python library for geometric mesh processing and finite element method (FEM) differential geometry computations on triangular and tetrahedral meshes. @@ -61,6 +101,17 @@ image: /static/pub/reuter_2009_lbeigenvaluesfunctions_lapy.png github: deep-mi/LaPy +- id: whippersnappy + name: WhipperSnapPy + tag: Visualization + description: > + Python/OpenGL tool for rendering brain surface meshes with color overlays and + generating publication-quality screenshots from the command line, Jupyter + notebooks, or an interactive desktop GUI. + image: /static/img/research/whippersnappy/teaser.jpg + url: /WhipperSnapPy/ + github: deep-mi/WhipperSnapPy + - id: fsqc name: FastSurfer QC tag: Quality Control diff --git a/index.html b/index.html index 19d3902..de876c5 100644 --- a/index.html +++ b/index.html @@ -167,11 +167,19 @@

AI-powered analysis of the human brain.

-

Research & Projects

-

We build open, validated computational tools for neuroimaging — - from whole-brain segmentation pipelines to geometric shape analysis libraries.

-
- {% for project in site.data.projects %} +
+
+

Research & Projects

+

We build open, validated computational tools for + neuroimaging — + from whole-brain segmentation pipelines to geometric shape analysis libraries.

+
+ + View all research → + +
+
+ {% for project in site.data.projects %}{% if project.homepage %} {% if project.image %} {{ project.name }} @@ -185,7 +193,7 @@

Research & Projects

Learn more →
- {% endfor %} + {% endif %}{% endfor %}
diff --git a/research/fatsegnet.md b/research/fatsegnet.md index a67cbc7..5cf518c 100644 --- a/research/fatsegnet.md +++ b/research/fatsegnet.md @@ -25,7 +25,10 @@ layout: lab
-FatSegNet is a fast and fully automated deep learning pipeline to accurately identify, segment, and quantify visceral and subcutaneous adipose tissue (VAT and SAT) within a consistent, anatomically defined abdominal region on Dixon MRI scans. The pipeline implements a three-stage design with our Competitive Dense Fully Convolutional Network (CDFNet) architecture at its core for localizing the abdominal region and segmenting abdominal adipose tissue. +FatSegNet is a fast and fully automated deep learning pipeline to accurately identify, segment, and quantify visceral +and subcutaneous adipose tissue (VAT and SAT) within a consistent, anatomically defined abdominal region on Dixon MRI +scans. The pipeline implements a three-stage design with our Competitive Dense Fully Convolutional Network (CDFNet) +architecture at its core for localizing the abdominal region and segmenting abdominal adipose tissue. {::nomarkdown}
@@ -36,7 +39,9 @@ FatSegNet is a fast and fully automated deep learning pipeline to accurately ide ## CDFNet Architecture -Our CDFNet adopts a Dense-Unet architecture extended toward competitive learning via maxout activations. The Maxout operation computes the maximum at each spatial location across feature maps instead of concatenating them. Benefits of competitive learning through Maxout activations: +Our CDFNet adopts a Dense-Unet architecture extended toward competitive learning via maxout activations. The Maxout +operation computes the maximum at each spatial location across feature maps instead of concatenating them. Benefits of +competitive learning through Maxout activations: - It promotes dedicated local sub-networks and improves feature selectivity through local competition. - Each sub-network can learn a sub-problem more efficiently. @@ -51,14 +56,22 @@ Our CDFNet adopts a Dense-Unet architecture extended toward competitive learning {:/nomarkdown} For more information on competitive learning: -- Estrada et al. "Competition vs. concatenation in skip connections of fully convolutional networks." MLMI 2018. [arxiv](https://arxiv.org/pdf/1807.07803.pdf) -- Goodfellow et al. "Maxout networks." arXiv:1302.4389 (2013). [arxiv](https://proceedings.mlr.press/v28/goodfellow13.pdf) -- Srivastava et al. "Understanding locally competitive networks." arXiv:1410.1165 (2014). [arxiv](https://arxiv.org/abs/1410.1165) -- Liao & Carneiro. "Competitive multi-scale convolution." arXiv:1511.05635 (2015). [arxiv](https://arxiv.org/abs/1511.05635) + +- Estrada et al. "Competition vs. concatenation in skip connections of fully convolutional networks." MLMI + 2018. [arxiv](https://arxiv.org/pdf/1807.07803.pdf) +- Goodfellow et al. "Maxout networks." arXiv:1302.4389 ( + 2013). [arxiv](https://proceedings.mlr.press/v28/goodfellow13.pdf) +- Srivastava et al. "Understanding locally competitive networks." arXiv:1410.1165 ( + 2014). [arxiv](https://arxiv.org/abs/1410.1165) +- Liao & Carneiro. "Competitive multi-scale convolution." arXiv:1511.05635 ( + 2015). [arxiv](https://arxiv.org/abs/1511.05635) ## Proof of Concept -FatSegNet was tested and validated in the [Rhineland Study](https://www.rheinland-studie.de/), a large prospective cohort study based in Bonn, Germany. We evaluate the whole pipeline with respect to robustness and reliability against two independent test sets: a manually edited set and a test-retest set. +FatSegNet was tested and validated in +the [Rhineland Study](https://www.rheinland-studie.de/en/research/research-areas/), a large prospective cohort study +based in Bonn, Germany. We evaluate the whole pipeline with respect to robustness and reliability against two +independent test sets: a manually edited set and a test-retest set. {::nomarkdown} @@ -100,10 +113,15 @@ FatSegNet was tested and validated in the [Rhineland Study](https://www.rheinlan ## News -- FatSegNet was selected as June 2020 [MRM Highlights](https://blog.ismrm.org/category/highlights/) by the ISMRM community — [Q&A interview](https://blog.ismrm.org/2020/06/19/qa-with-santiago-estrada-and-martin-reuter/) · [reproducible research interview](https://blog.ismrm.org/2020/07/03/reproducible-research-insights-with-santiago-estrada-and-martin-reuter/). -- The tool has been deployed in 2,738 participants from the [Rhineland Study](https://www.rheinland-studie.de/), processing 16,520 liters of abdominal adipose tissue. -- We are collaborating with [GenerationR](https://generationr.nl/) to improve domain adaptation to a wider population (age < 30). -- One of our paper images appeared on the cover of the April 2020 edition of [Magnetic Resonance in Medicine](https://onlinelibrary.wiley.com/toc/15222594/2020/83/4). +- FatSegNet was selected as June 2020 [MRM Highlights](https://blog.ismrm.org/category/highlights/) by the ISMRM + community — [Q&A interview](https://blog.ismrm.org/2020/06/19/qa-with-santiago-estrada-and-martin-reuter/) · [reproducible research interview](https://blog.ismrm.org/2020/07/03/reproducible-research-insights-with-santiago-estrada-and-martin-reuter/). +- The tool has been deployed in 2,738 participants from + the [Rhineland Study](https://www.rheinland-studie.de/en/research/research-areas/), processing 16,520 liters of + abdominal adipose tissue. +- We are collaborating with [GenerationR](https://generationr.nl/) to improve domain adaptation to a wider population ( + age < 30). +- One of our paper images appeared on the cover of the April 2020 edition + of [Magnetic Resonance in Medicine](https://onlinelibrary.wiley.com/toc/15222594/2020/83/4). {::nomarkdown}
diff --git a/research/index.html b/research/index.html index fbef271..749f533 100644 --- a/research/index.html +++ b/research/index.html @@ -12,6 +12,7 @@ gap: 1.25rem; margin-top: 2rem; } + .res-dir-card { background: #fff; border: 1px solid var(--lab-border); @@ -19,13 +20,25 @@ border-radius: var(--lab-radius); padding: 1.25rem 1.4rem; } + .res-dir-card h3 { - font-size: 1rem; font-weight: 700; margin: 0 0 0.35rem; + font-size: 1rem; + font-weight: 700; + margin: 0 0 0.35rem; } + .res-dir-card p { - margin: 0; font-size: 0.91rem; color: var(--lab-muted); line-height: 1.6; + margin: 0; + font-size: 0.91rem; + color: var(--lab-muted); + line-height: 1.6; + } + + @media (max-width: 680px) { + .res-directions { + grid-template-columns: 1fr; + } } - @media (max-width: 680px) { .res-directions { grid-template-columns: 1fr; } } @@ -56,7 +69,8 @@

Research & Projects

{{ project.description }}

{% if project.github %} - + {{ project.github }} {% else %} @@ -104,7 +118,8 @@

Computational Geometry & Topology

Neurodegeneration & Brain Development

Understanding brain development and neurodegeneration (aging, Alzheimer's, Huntington's disease) via multi-modal imaging of large population cohorts - such as the Rhineland Study.

+ such as the Rhineland + Study.

@@ -120,7 +135,8 @@

Publications

View all publications → - Google Scholar → + Google Scholar →
diff --git a/static/img/research/neurocade/teaser.jpg b/static/img/research/neurocade/teaser.jpg new file mode 100644 index 0000000..a3f7822 Binary files /dev/null and b/static/img/research/neurocade/teaser.jpg differ diff --git a/static/img/research/whippersnappy/teaser.jpg b/static/img/research/whippersnappy/teaser.jpg new file mode 100644 index 0000000..6ad0dab Binary files /dev/null and b/static/img/research/whippersnappy/teaser.jpg differ