Abstract: In this paper, a multi-head self-attention based model is proposed for predicting rate of penetration (ROP) in drilling process, which has four main stages (raw data cleaning, drilling data ...