This will be available in the next release of .NET Microsoft Graph client library. It will work the same as the functionality in the .NET OneDrive client library. You can review this in my working branch. You can provide feedback in the repo.
Email codedump link for Microsoft Graph - .NET SDK - OneDrive Large File Upload (> 4MB in size)