You can now use ADF built-in delete activity in your pipeline to deletes undesired files without writing code. You can delete either folder or files from Azure Blob Storage, Azure Data Lake Storage Gen1, Azure Data Lake Storage Gen2, File System, FTP Server, sFTP Server, and Amazon S3.
Get started using delete activity in ADF from here.