Shaping and Successive Approximations

Operant conditioning is learning that occurs based on the consequences of behavior and involve the learning of new actions. It commonly uses reinforcement and punishment to influence behavior. Reinforcement is anything that increases the desired behavior, while punishment is anything that decreases the undesired behavior. Additionally, there is both positive and negative types for reinforcement and punishment. Positive is when something pleasant is added, while negative is when something unpleasant is removed. For example, when your mom is nagging you to clean your room, and then you clean it, so she stops nagging; the nagging is the negative reinforcement because the stimulus is removed (nagging) to increase the desired behavior (cleaning your room).

One type of operant conditioning that is used is called shaping, which is how reinforcers guide behavior closer towards a desired behavior. This is how dogs are trained. Complex behaviors are able to be created through this technique. By using successive approximations, or “middle steps,” animals are able to be trained to do complex behaviors such as discriminating many types of objects and events.

I trained my dog, Hudson (pictured above), to play dead using shaping and successive approximations. I used a high-value treat as positive reinforcement when Hudson completed the desired behavior. We started by having him lay down from a standing position. This was easy because he had learned to lie down previously. Then we had him roll onto his back with his feet up. This was a little more challenging because it was not necessarily biologically predisposed to voluntarily lying on his back. This took about 2 days to get him to do correctly. Then we also taught him to “come alive” which was his release phase. This did not take long for him to learn. Through shaping and using in between steps to teach him, Hudson successfully learned to play dead and come alive!

 

Operant Conditioning

Shaping is a part of operant conditioning used to develop a behavior in an individual. “Shaping reinforces guide behavior closer towards a desired behavior,” also known as successive approximations (Wede). Shaping was first used by B.F. Skinner when he invented the Operant Chamber to study animal behavior. Skinner would use the chamber as a box to train the rats to press down on a lever in order to get food, water, or another reinforcer. He trained the rats by using successive approximations, he continued to reinforce until the final behavior was reached. If the rat was close to pressing down the lever it was rewarded. Rewards were given until the rat learned to press down on the lever. Shaping is common in everyday life, like learning how to do something. For example, I have used shaping to train my brother’s cat. Similar to a dog, I have shaped the cats behavior by first giving him a treat, repetitively telling him to give me his paw, and then once he does I will give him another treat. The treat served as a positive reinforcement, which worked to increase the cat’s behavior by presenting a positive stimulus. After many cycles of this, he eventually learned that when he wanted a treat that he would give me his paw first and then I would give him a treat. It is important to understand if the individual is not progressing, to use simpler steps of reinforcing. They will not learn the new behavior right away, so it will take time. I think shaping is a really interesting principle because essentially this is how both humans and animals learn. Our parents raised us with techniques involving shaping. How do you think we were able to walk, talk, be potty trained, as infants? I am sure we would have learned eventually by observing others, but the only way for it to be built into us was for our parents to shape it. 

 

Wede, J. (2019). Introduction to Psychology, lecture 15 notes [Powerpoint slides]. Retrieved from https://psu.instructure.com/courses/2006917/files/104343631?module_item_id=27881395

 

Successive Approximations

About 67% of all US households have some sort of pet, whether it be a dog, cat, fish, or even a lizard. Out of these 85 million families sustaining animals, for about 12 years now, I have been included within this percentile. In my particular case, I have had two dogs, both Golden Retrievers, and like many have trained them in certain ways to perform special tasks. It starts out with name recognition, then housetraining, and any others that one might want to follow through with like sitting, laying down, or rolling over. For any pet owners out there, we all know this is not an easy task and requires immense amounts of patience and repetition. One way to make something like this easier for both the owner and the dog is a type of operant conditioning we learned about called shaping. The idea of shaping first came from B.F. Skinner who discovered this phenomenon while expanding upon Edward Thorndike’s view on operant conditioning. Shaping offers an easier way to teach animals to act as a desired behavior through a method of positive reinforcement of behavior patterns. This term can also be called successive approximation and has been known to train animals to discriminate many types of objects and events. Skinner tested this theory on rats by breaking down behaviors into small, achievable steps in order to get them to press a lever to release food. Skinner would reward the rats for each step closer to the desired behavior, even if it meant them just slightly getting closer to the lever. By using this method of operant conditioning, Skinner trained the rats to perform proper behavior while deterring improper behavior.

Just like Skinner did with his rats, I used the same method of shaping on my dogs to teach them proper behavior. The main tasks my family and I would focus when training them were talents like sitting, laying down, and rolling over, as well as normal operations like, housetraining. For the talents, I started with teaching my dogs to sit by pushing their behind to the ground while saying the word “sit”. I would do this a couple times before rewarding them with a treat. This became a repetitive process for a couple days until they finally got a hang of it and it became instinct for them. After this, I proceeded with the same actions to teach them how to lay down. I would start out with saying “sit” in which they would sit to make sure the behavior is instilled in them and then repeated the previous process. I would physically push them to the ground multiple times, without causing any harm don’t worry, and then reward with a treat. Once again, I repeated this for a couple days and then used the same process for rolling over until all three activities were implanted within their minds and they could perform them without the retrieval of any treats. As well, I used the same system of treats for housetraining. Whenever they would go to the bathroom in the house, no treat was rewarded and we would occasionally yell at them, but if they went to the bathroom outside, a treat was rewarded. Both dogs eventually began waiting by the front door whenever they would have to go to the bathroom and then expected a treat afterwards. The desired behavior became so repetitive that both dogs could be let outside alone, with no leash, and would wait by the door until let in expecting a treat in the end. Even though this may not be successful in all cases of animals or dogs, it was quite fascinating to me how this worked so well for my dogs that we could trust them outside with no leash or electric fence with no worries.

References

https://courses.lumenlearning.com/boundless-psychology/chapter/operant-conditioning/

https://www.iii.org/fact-statistic/facts-statistics-pet-statistics