System Message:

Australian Immigration Daily News

Breaking Australian immigration news brought to you by Migration Alliance and associated bloggers.

  • Home
    Home This is where you can find all the blog posts throughout the site.
  • Categories
    Categories Displays a list of categories from this blog.
  • Tags
    Tags Displays a list of tags that have been used in the blog.
  • Bloggers
    Bloggers Search for your favorite blogger from this site.
  • Team Blogs
    Team Blogs Find your favorite team blogs here.
  • Login
    Login Login form
Posted by on in General
  • Font size: Larger Smaller
  • Hits: 4311
  • 2 Comments

The Office of the MARA's illegitimate CPD surveys

I have just sent this email to the Office of the MARA's Director of Professional Development and Registration, Glenda Hutch.  Feel free to complete the survey and skew the results even more.  It's not like OMARA want real information.  They just want any old information so that it looks like they are interested in real results.  It's really just a triumph of form over substance.  If they want proper feedback on what people think about CPD's then why don't they leave the surveys up to private organisations who know how to conduct surveys properly and professionally to extract the right data and information the first time around?
 
Dear Glenda

With reference to the link in your email below 'CPD participant feedback - Distance Learning': https://www.surveymonkey.com/s/ltadnjanmar14

I just completed a 'dummy/imposter' survey off the link that you have sent out to CPD participants of LTA.  We have a huge number of participants.
 
I notice three things about this survey which concern me greatly:
1/ Survey Monkey is a non- Australian government based website based in the USA being used to collect information from random and unidentified persons (MARN is optional) regarding Legal Training Australia.   
2/ Anyone from anywhere in the world can complete the survey including me as I did just then as a test run.  I just completed the survey as an 'imposter' as a test by clicking on the link which means OMARA's results are already skewed.  I can see I am also able to re-do the survey by logging back on and doing it again at a different computer in my office.
3/ I can complete one (1) distance learning CPD module with LTA online, and yet I am able to go to the OMARA Survey Monkey web link and provide feedback regarding every single one of our online subjects if I want to, regardless of whether I have even completed them. 
 
Having a survey and making the link available to anyone who wants to participate is a risky approach as it means the survey designed lacks integrity which in turn means that the results lack validity.  In most cases, the people electing to participate are inherently biased in some fashion.   What's to stop me from running an active campaign against another provider by using their dedicated link and running an active campaign for my own business by using the link to the LTA survey?  The answer is nothing.  It is open to being rorted.

I can also see that the OMARA have not created a survey which prevents the following types of 'survey offenders' from participating:

1. “The Daydreamer” - this respondent does not read the questions or stay focused enough to understand what is being asked.  Known Accomplices: “The Woolgatherer,” “The Aloof,” “Mr. or Ms. Elsewhere”

2. “The Imposter” - this respondent provides false data to a) bias survey results or b) fraud data to qualify for a survey with an incentive being offered.  Known Accomplices: “The Survey Swindler,” “The Con,” “The Pretender”

3. “The Speeder” - this respondent races through the survey in record time, click after click after click, leaving a trail of data integrity destruction in his/her path.  Known Accomplices: “The Express,” “The Research Runner,” “The Straightliner”

Given that this is a government body conducting a survey of RMAs regarding an approved CPD provider I would consider it best that you pull these surveys and start again.  I have had a good lok at the survey and cannot see that the OMARA have done due diligence on any of the following before conducting these surveys:

  • 1: Find a trustworthy sample house.  A lot of the imposters can be eliminated through filtering of sample.
  • 2: Add a hidden variable for TTC (time to complete) the survey.  Set a parameter during the data collection process.  Plan to remove the first 2% or 5% of outliers who completed the survey in the least amount of time.  Or you can review the TTC variable manually; if the tested survey takes 12 minutes to complete and you have respondents who completed it in under 5, you have identified your speeders.
  • 3: Take a demographic question you asked in the beginning of the survey and repeat it at the end (age, zip code, number of people in household).  If the answers do not match, you’ve singled out the 3 offenders.
  • 4: Work in a trap or verification question – ask the respondent to select #4 below or type ABC in the box below.   Another option is to list a product/service/company that does not exist and place it in the grid with others.   If they do not select or answer correctly or rate something that doesn’t exist, disqualify them from the survey.  Some companies use opposite wording or double negatives for this.  I argue against it as it confuses respondents and often frustrates them to a point of dropping out.

I would argue that any data OMARA has received to date on any of the CPD providers is flawed and cannot be relied upon.  The survey access is not limited to RMAs and can be done without a MARN.  The links have also been sent to persons who have not completed the CPD including two persons in my office. 

For these reasons I would like to request that you stop requesting that agents who are completing LTA's CPDs complete the online survey until OMARA has a valid survey with restricted access for agents who have actually completed the CPD in question.  

Finally I note that the emails being sent out to agents are not from a particular officer within the OMARA and there is no position number identified either.  It is a requirement that all DIBP officers properly identify themselves.  Could you please also fix the communication from your office as agents have a right to know who communication is coming from. 

Thank you.

Liana Allan

LTA


COPY OF THE OMARA EMAIL BEING SENT OUT TO AGENTS COMPLETING CPD:

From: Helen Fisher [mailto:This email address is being protected from spambots. You need JavaScript enabled to view it. ]

 
Sent: Wednesday, 23 April 2014 11:26 AM
Subject: CPD Participant Feedback - Distance Learning CRM:0016034

 

Dear Registered Migration Agent,

 

I am writing to you because you have been reported by the Legal Training Australia as having undertaken their distance learning (private study) CPD activities between January and March 2014.

 

The Authority undertakes regular CPD reviews to ensure that the provision of CPD activities for registered migration agents remains relevant and of a high standard.  One of the ways we do this is to ask agents about their experience with specific CPD activities.  Accordingly, we invite you to provide us with your feedback about the abovementioned activities through a short survey.

 

Please be assured that all information will be treated with the strictest of confidence. Prior permission will be sought in the instance where use of any of this information might breach anonymity.

 

If you wish to participate in this survey, please click on the following link:  CPD Participant Feedback – Distance Learning.

 

Note:  Please disregard or select “Not Applicable” for those activities listed in the feedback form that you did not undertake.

We will be seeking feedback on these CPD activities until close of business on Friday, 9 May 2014.

 

Yours sincerely,

Professional Development| Office of the Migration Agents Registration Authority

Level 10, 111 Elizabeth Street, Sydney NSW 2000 | M PO Box Q1551, QVB NSW 1230

P 1300 226 272 | F +612 9078 3591 |

E This email address is being protected from spambots. You need JavaScript enabled to view it. | W  www.mara.gov.au

Last modified on
Rate this blog entry:
2

Comments

  • Guest
    D.L.W Thursday, 24 April 2014

    Hi Liana,
    Agreed that the survey could work against you, however in my humble opinion, and certainly from the feedback I provided to them, it worked in your favour. I agree, I am far too busy to look up which CPD's I have done, so I just ticked every single one of them for every question and maked every one with the top score of excellent (or whatever the most favourable answer was) For me, these online CPDs are a god send and I want them to continue and therefore I have scored them the best I could.
    Kind regards
    Happy with LTA Agent

    Reply Cancel
  • Liana - Allan
    Liana - Allan Thursday, 24 April 2014

    Hi there DLW thanks a lot for your feedback. I also ticked everything as excellent and I also ticked stuff I had not completed. The whole thing is a farce and at this point I am not sure anything put on the survey is relevant anyway. We conduct our own surveys too and lock them down and force agents to put their MARNs so I think our data is reliable. If you want something done properly ask the private sector professionals to do it.

Leave your comment

Guest Monday, 25 November 2024
Joomla SEF URLs by Artio