There are many things in this life that are not sinful in and of themselves, but when they are misused they can be deemed as sinful or harmful.
There are two categories of sin: sins against God and sins against man. By default, every sin is against God. Yet, not all sin is against man.