Objective
• Automate the aggregation of URL meta data, including basic scoring and exporting of output

Deliverables
• UI for management of URL lists, including creation of list groups and exporting of lists and list data
• Back end lookups and API parsing of URLs from SEMRush API
o Basic calculations using SEMRush data

Requirements
1) Create New UI
a) User creates campaign and provides name (campaign_name)
b) Campaign comprises up to two source input lists: keywords, URLs


2) Perform Data Lookups

a) Keyword Lookups
i) Looked up against SEMRush Organic Search results
ii) Output fields to parse
(1) Rank
(2) Domain
(3) URL

b) URL Lookups

i) Inputs
(1) Use lookup Domain result from keyword lookup (a) above
(2) Use manually entered domains in step 1

ii) Looked up against SEMRush
(1) (by+organic_organic) - Competitors in organic search report
(2) http://us.api.semrush.com/?action=report&type=domain_organic_organic&key=XXXXXXXXXXX&display_limit=10&export=api&export_columns=Dn,Np,Or,Ot,Oc,Ad&domain=pretarget.com/resources.html

iii) Output fields to parse (numeric)
(1) Dn - Sites competing with this site in search results, sorted by the number of common keywords
(2) Np - The number of keywords for which the site is displayed in search results next to the analyzed site
(3) Or - Keywords this site has in the TOP20 organic results
(4) Ot - Estimated number of visitors coming from the first 20 search results (per month)
(5) Oc - Estimated cost of purchasing the same number of visitors through Ads
(6) Ad - Keywords this site has in the TOP20 Ads results


3. Merge, Calculate Data

i) Frequency = Calculate frequency of occurrence for each URL and TLD
ii) Sum Each
(1) Common Keywords
(2) Organic Keywords
(3) Organic Traffic
(4) Organic Cost
(5) Adwords Keywords
iii) Keyword Overlap = Common Keywords/Organic Keywords
iv) Value Per Visitor = Organic Cost/Organic Traffic

4. Search & Export/Report UI
i) Searches by keyword wild card
(1) campaign_name
(2) Source keyword
(3) Source URL/Domain
(4) Result URL
(5) Result Domain
ii) Sort by Frequency, largest to smallest
iii) Show first 50 results
iv) View Report Parameters Above results
(1) Search Field
(2) Search Value
(3) Google US
(4) Date/Time of Lookup
v) View fields on screen
(1) Source keyword or source url
(2) URL
(3) Domain
(4) Frequency
(5) Sum of Common Keywords
(6) Sum of Organic Keywords
(7) Sum of Organic Traffic
(8) Sum of Organic Cost
(9) Sum of Adwords Keywords
(10) Keyword Overlap
(11) Value Per Visitor
(12) Average Rank
(13) Average Page
vi) Click to export all results to Excel

Constraints
• Designed for maximum future flexibility
• SEMRush Databases: US Google only
• 20 results per keyword for organic search results