When #GenAI Ideas translate to practice with #DHTI nuchange.ca/2026/03/when-gen… Thank you @Hanson1954 for making this happen!
1
26
Are we trapped in a #Matrix ? nuchange.ca/2025/11/are-we-t…
18
DHTI: a reference architecture for Gen AI in healthcare youtu.be/5jFFe3wqKM0?si=zWXw… via @YouTube
32
Imagine setting up a #ChatEHR using #FHIR and #CDSHooks in just 15 minutes. Give it a try today, and while you’re there, explore the broader concept of #DHTI github.com/dermatologist/dht…
2
42
Design Science Research in #healthcare : Bridging the Gap Between Ideas and Impact nuchange.ca/2025/11/design-s…
17
Bell Eapen retweeted
Elated to share that the Weinstock lab just got its 1st R01!!
We are SO grateful to the hardworking NIH staff for tirelessly pushing to get those last NOAs out
#LLM-in-the-Loop #CQL execution with unstructured data and #FHIR terminology support nuchange.ca/2025/06/v-llm-in… via @beapen
33
Bell Eapen retweeted
Genomic Tokenizer: Toward a biology-driven tokenization in transformer models for DNA sequences biorxiv.org/content/10.1101/… 🧬🖥️🧪 github.com/dermatologist/gen…
Bell Eapen retweeted
Genomic Tokenizer: Toward a biology-driven tokenization in transformer models for DNA sequences
1. Genomic Tokenizer (GT) introduces a biologically grounded approach to DNA sequence tokenization, aligning with the central dogma of molecular biology by using codons—three-letter nucleotide sequences—as the core unit of tokenization.
2. Unlike traditional character or k-mer tokenizers, GT recognizes start and stop codons, assigns identical tokens to synonymous codons, and treats introns and out-of-frame regions as UNK tokens, reducing vocabulary size while preserving biological relevance.
3. GT is implemented within the HuggingFace tokenizer framework, enabling seamless integration into existing transformer-based DNA analysis pipelines and support for tasks like masked language modeling and sequence classification.
4. The tokenizer supports customizable start/stop codons and intron treatment, making it adaptable for different organisms, including prokaryotes and mitochondrial genomes.
5. In classification experiments using a lung cancer-related variant dataset, GT showed greater robustness to long sequence lengths compared to character tokenization, and outperformed it in longer sequence tasks.
6. While byte-pair encoding (BPE) achieved the highest overall performance, its large vocabulary comes with high computational cost. GT balances biological insight with computational efficiency and a compact vocabulary.
7. GT tokenization avoids issues of redundancy and information leakage in masked language modeling that are common in overlapping k-mer tokenizers, leading to cleaner training signals and potentially better generalization.
8. The biological foundation of GT allows it to better model frame-shift mutations, synonymous substitutions, and stop-gain variations—key features in predicting phenotypic impact from genetic data.
9. Preliminary comparisons highlight GT’s strength in biological modeling and suggest potential advantages for foundational model training across genomics tasks when compared with purely data-driven tokenizers.
10. GT is open-source, installable via PyPI, and encourages broader exploration across genomic datasets and transformer architectures, including long-context models such as HyenaDNA.
💻Code: github.com/dermatologist/gen…
📜Paper: biorxiv.org/content/10.1101/…
#Genomics #Tokenization #Transformers #Bioinformatics #DNASequence #LLM #Codon #MaskedLanguageModel #DeepLearning #HuggingFace
Try this #DNA #tokenizer in your transformer model training pipelines. Feedback will be highly appreciated.
Genomic Tokenizer: Toward a biology-driven tokenization in transformer models for DNA sequences biorxiv.org/content/10.1101/… #biorxiv_bioinfo
33
Complement or substitute? How AI increases the demand for human skills ino.to/Wrgjg0N
1
42
Navigating the Complexities of #GenAI in #Medicine: 5 Software development Blunders to Avoid nuchange.ca/2024/03/navigati…
82
Cornell Researchers Introduce Graph Mamba Networks (GMNs): A General Framework for a New Class of Graph Neural Networks Based on Selective State Space Models marktechpost.com/2024/02/21/… via @Marktechpost
103
Counterfactual formulation of patient-specific root causes of disease ino.to/BUOC8hS
47
#Distilling #LLMs step by step to small task-specific models nuchange.ca/2023/08/distilli… via @beapen
1
117








