Perl script monitors payments and feedback in eBay sales
Watchful Seller
We show how to use a screen-scraper and an application for the official eBay API to trigger an alarm on incoming eBay customer feedback and detect errors in the monthly billing statement.
If I ever get around to writing my memoirs, I am going to include a lengthy chapter about my life's motto, which is: "Anything you don't constantly monitor is guaranteed to go belly up when you least expect it." True to this motto, I wrote a script this month to receive an email immediately when one of my eBay customers has left feedback about a transaction.
Simply Scraping
As a quick and dirty solution, and to first avoid having to register as a developer with eBay, I wrote a screen-scraper that extracts the current feedback score from the slew of HTML on the feedback page, before saving the counter and raising the alarm during subsequent runs if the value has increased.
When I click on my username on eBay.com, the browser lands on the feedback page in Figure 1. Selecting view-source
in the browser shows the HTML code from Figure 2, and a text search for the string 362
(the current feedback score) shows that this number is found in a markup tag of the mbg-l
class:
( 362<img src="...
An XPath processor such as HTML::TreeBuilder::XPath can easily retrieve the content of this tag. The query
/html/body//span[@class="mbg-l"]
locates all span
elements in the HTML body that have a class
attribute with a value of mbg-l
. The double slash in the expression indicates that the requested elements can exist at an arbitrary nesting depth beneath the HTML body tag.
The XPath query then spits out a string such as ( 362) (...
. From there, with a regular expression in Perl, extracting the score is child's play. Listing 1 does exactly this in the feedback_fetch
function in line 70, and then saves the score that was found in a cache file. Then, on the next run, it compares the value with the one obtained at that point, and fires off an email if the number has increased [1].
Listing 1
ebay-feedback
Email at Your Command
Writing and reading the cache data, which saves the feedback score confirmed during the last run as its only value, is handled by the slurp
and blurt
functions. These are from the CPAN Sysadm::Install module, which exports them in line 3. To retrieve the eBay page, the script uses the slimmed-down LWP::Simple module, whose get
method simply runs an HTTP request for the specified URL and, if successful, returns the content of the page that was found.
On Linux, it is often very easy to send mail with the /usr/bin/mail
utility; the CPAN Mail::DWIM module is recommended for those wanting more flexibility. Because I already replaced /usr/bin/mail
on my Linux box at home with a Perl script that can cope with my ISP's requirements, I left things as is. Figure 3 shows the email that landed in my Gmail inbox.
Before firing it up, the parameters in the script header still need to be tuned to match the local conditions. In line 8, the $nick
variable receives the name assigned to the eBay user, whose feedback counter will be monitored by ebay-feedback
. The URL is valid for US eBay accounts, whereas UK accounts run on ebay.co.uk instead. Finally, in the $mail_to
variable, line 23 requires the email address of the user to whom the alerts should be sent.
Monitoring the Monitor
How can you monitor whether the script is still functioning, or whether eBay has changed its page layout? Listing 1 records all the operations for that purpose via Log::Log4perl in the log file ~/logs/ebay-feedback.log
. Additionally, for instance, a daily Nagios script could trawl through the data that show up there based on a pattern such as "OK" under the current date, and sound the alarm if it is not found."
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Fedora 40 Beta Released Soon
With the official release of Fedora 40 coming in April, it's almost time to download the beta and see what's new.
-
New Pentesting Distribution to Compete with Kali Linux
SnoopGod is now available for your testing needs
-
Juno Computers Launches Another Linux Laptop
If you're looking for a powerhouse laptop that runs Ubuntu, the Juno Computers Neptune 17 v6 should be on your radar.
-
ZorinOS 17.1 Released, Includes Improved Windows App Support
If you need or desire to run Windows applications on Linux, there's one distribution intent on making that easier for you and its new release further improves that feature.
-
Linux Market Share Surpasses 4% for the First Time
Look out Windows and macOS, Linux is on the rise and has even topped ChromeOS to become the fourth most widely used OS around the globe.
-
KDE’s Plasma 6 Officially Available
KDE’s Plasma 6.0 "Megarelease" has happened, and it's brimming with new features, polish, and performance.
-
Latest Version of Tails Unleashed
Tails 6.0 is based on Debian 12 and includes GNOME 43.
-
KDE Announces New Slimbook V with Plenty of Power and KDE’s Plasma 6
If you're a fan of KDE Plasma, you'll be thrilled to hear they've announced a new Slimbook with an AMD CPU and the latest version of KDE Plasma desktop.
-
Monthly Sponsorship Includes Early Access to elementary OS 8
If you want to get a glimpse of what's in the pipeline for elementary OS 8, just set up a monthly sponsorship to help fund its continued existence.
-
DebConf24 to be Held in South Korea
Busan will be the location of the latest DebConf running July 28 through August 4