Are you looking for sport or food, or both? If you're just trying for food you can do set lines. Scrounge up some bait, grubs from inside rotted logs, dig worms, etc. Find some fairly stout tree branches that stick out over the stream or lake, the deeper the water the better. Cut a piece of line long enough to tie to the tree limb and reach into the water with your hook, bait and a sinker on the business end. Tie about a half a dozen of these at various places. BE DISCREET! In most states set lines are illegal but if someone doesn't see you setting them or checking them then it's hard for them to catch you. It's not like the warden seeing you standing on the bank with a pole, but not a license, which can be a pretty big fine. So after you set the lines, find something else to do for a couple of hours, then go back and discreetly check them. As long as the fish stays in the water it will stay fresh and not spoil. Please remember to pull all of your lines when you're done for the sake of the fish you aren't going to be around to eat.
Before the comments. I fully realize that this method isn't "sporting", which is why many states call it illegal. My purpose with the post, and when I do this, is to try and ensure a fairly cheap, very sustainable, and extremely nutritious (except for the biotoxins) food source for whoever wishes to use this method. Instead of using one line you use six which ups the chance of getting fed in a much shorter time span and greatly increases the chance that you catch anything at all. Once again, please pull all your lines when your done. Protect the resource but feed yourself.
You shouldn't need a thousand dollar fly rod and a piece of paper (license) to eat a fucking fish.