Prof Melinda Hodkiewicz University of Western Australia

Prof Melinda Hodkiewicz

Chief Investigator

Theme 1

2023-03-01



Total Energy Global Technical Head office (Pau, France)

Total Energy Global Technical Head office (Pau, France) - 3 senior data management people

Transformer-based language models are very effective on 'regular' texts.

  • • Transformer model pipeline is a solved problem, the challenge for industrial users is the preparation of the data, encoding and transfer learning.
  • • Opportunity: The future (for industry) is small curated data sets for transfer learning.
  • • Risk: Language models do not handle uncertainty and always produce an output however nonsensical the input