Total Energy Global Technical Head office (Pau, France)

Total Energy Global Technical Head office (Pau, France) - 3 senior data management people

Transformer-based language models are very effective on 'regular' texts.

• • Transformer model pipeline is a solved problem, the challenge for industrial users is the preparation of the data, encoding and transfer learning.
• • Opportunity: The future (for industry) is small curated data sets for transfer learning.
• • Risk: Language models do not handle uncertainty and always produce an output however nonsensical the input