Although is followed by a clause with a subject and verb. Despite is followed by a noun or an ing form. Do not use despite of in this structure.
Practical examples
Although it was raining, we continued.
رغم أن الجو كان ممطرًا، تابعنا.
Despite the rain, we continued.
رغم المطر، تابعنا.
Despite feeling tired, she finished the report.
رغم شعورها بالتعب، أنهت التقرير.