I may be thinking of this problem orthogonally to the intent of this product... but do you think you could ever make a "task source" plugin system?
For example, a user could "log in" to a issue tracker like Jira/Trac/Bugzilla/Mantis - I think Mylyn does this pretty well.
Maybe the answer is to do some sort of "Hook script" type of thing - it sure would be great to be able to see how long a project really took and what bugs or components ate up most of the time.
Again, this could be the wrong discussion for the wrong product.