Obi/Deid Roberta I2b2

The model is fine-tuned on an English medical dataset (i2b2), which limits its effectiveness in non-English contexts.

RoBERTa models can struggle with long input sequences due to fixed context window, leading to potential inaccuracies or increased computational cost for chunking.

Running RoBERTa-based models requires substantial GPU memory and processing power, which can be prohibitive in resource-constrained environments.

The model's performance is heavily reliant on the comprehensiveness and representativeness of the i2b2 dataset, which may not cover all possible PHI scenarios or edge cases.

Setting up a production-ready environment involves configuring dependencies, managing model weights, and ensuring compliance with medical data standards, which can be challenging without extensive experience.