Add support for Transformers 4.48

[cgpeltier]

Describe the feature you'd like
Add support for Transformers >=4.48.0 (which includes ModernBERT) to be used with the HuggingFaceModel class: https://github.com/huggingface/transformers/releases/tag/v4.48.0

How would this feature be used? Please describe.
To be used with the HuggingFaceModel class

Describe alternatives you've considered
Alternatively, newer transformers versions can be used with the regular PyTorch estimator.

[benieric]

Hi @cgpeltier , we recently released support for 4.46.1 - https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/image_uri_config/huggingface.json#L17

Not sure if this would help unblock you, but alternatively, you can keep an eye on releases of the Deep Learning Containers - https://github.com/aws/deep-learning-containers/blob/master/available_images.md

And directly use the image uris

[geraldstanje]

hi @benieric @nargokul can you help to add support for Transformers >=4.48.0 image so we can use modernBERT?

@cgpeltier could you share how you deployed it currently?

[benieric]

Just an update - looks like this should be enabled soon:

DLC container for transformers 4.49 looks to be in the works - aws/deep-learning-containers#4602