Usually config files are stored in ".application" (where your application is IceWM) So yes, it should be there.
To edit it I would just look around and test a few things, edit a few files etc. See what happens.
If anything goes wrong, you can just delete the ".icewm" directory. (This will remove all personal IceWM configuration and use the default..I hope
I do this all the time!)