python3: Cache async channel FDs so that updates always happen correctly.