Beacons are a new technology that enables proximity sensing. They are small, cheap devices that can be detected by smartphones in order to provide location information when GPS is not available. As with all new technologies it pays to work with them hands-on in order to understand their benefits and limitations, so we have started testing them against real-life scenarios.  Because this technology is evolving from month to month, we will try to share results in a timely manner.

The new breed of beacons, based on the Bluetooth Low Energy specification, have the potential to simplify projects that need proximity awareness.  They work by passively broadcasting an identifier that devices such as smartphones can pick up.  Then they can be used as triggers and data sources in any number of mobile apps with little changes. Small initial cost, little maintenance, re-uses, what’s not to love?  Well, maybe some practical limitations at this level of maturity.  For example, many scenarios long dreamed of by retailers, conference hosts or others call for a precise location of the user.  If you want to send the consumer a voucher for a 2-for-1 for the item s/he is looking at, you need to know the location to the inches.  If you want to greet him/her by name, you need a foot or two of precision.  Do beacons provide the stability and accuracy needed for that?  That is what we will investigate in this blog post. If you want the TL;DR spoiler: presence detection is good, but precise positioning not there yet.

To check the precision of the indoor positioning that can be derived by current beacon technology I planned to use triangulation calculations, more accurately called “trilateration” in the case of a 2D implementation. That requires as a basis a measure of the distance from 3 fixed points, the beacons.  However, the findings are that the trilateration could not be performed, because of the lack of accuracy in the measure of the distance from receiver to beacon.  There seem to be four main reasons to that lack of accuracy.

     1) The signal strength of each beacon fluctuates a lot even when the beacon, the receiver and the testing environment are stationary. The noise of the signal data from the beacons was so random that I couldn’t smooth the data to capture important patterns in the data set.

     2) Depending on the way that the user is handling the receiver device, the readings can change a lot as well.

     3) The state and configuration of the beacons such as battery life, advertising interval and broadcasting power impact the readings.

     4) The readings also change with the operating system of the receiver devices.

As a result, I would say that beacon technology is not ready for indoor positioning, tracking, navigation or scenarios that require precise location. For the time being, it would be better to concentrate them on proximity detection, what we can call “presence”. 

Overview

I conducted the same experiments with iOS and with Android as receiver devices.  I tested out three different manufacturer’s beacons: Estimote, Gimbal (Qualcomm) and Tōd, which look as follows roughly at scale.

Capture1.PNG

I used three beacons of the same brand in each test, gave them fixed positions and logged the distance evaluated by the receiver for trilateration calculation and for statistical analysis. To reproduce the test, you can follow the Experimental Setup section below.  For sample results, look into the Test Results section, and for theoretical overview of the methods into the Trilateration section.  And let me know of your findings!

Experimental Setup

  • Steps to pre-configure the beacons
    • Estimote  beacons
      • Download Estimote Virtual Beacon app from Apple store
      • Launch the app and click on Beacons button
      • Select any beacon appears on the Beaons in range screen
      • In the Beacon Details screen, click each attribute and enter the value in the setup table below
    • Gimbal beacons
    • Tōd  beacons
  • Set up ofthe beacons
Beacon maker Hardware revision Broadcasting power Advertising interval Operating system
Estimote D3.3 4 dBm 200ms Estimote OS A1.9
Tōd 1.0B 15 dBm 100ms Unknown
Gimbal Series 10 0 dBm Unknown

Rev. 1.7.A

  • Test room dimensions : L 4.7 m x W 5.9 m x H 2.6 m
    • The test room had no moving objects that could interfere with the experiment.
  • Devices
    • LG Nexus 5 with Android 4.4.2
    • iPhone 4S with iOS 7.1
  • Test app scan interval: the app scans for beacons every 2 seconds for a duration of 10 minutes.

18 Tests were conducted, i.e., all combinations of:

  • 3 different beacon makers: Estimote, Gimbal, Tōd
  • 1 SDK: Estimote SDK, used for both iOS7 and Android (Estimote 0.4) – note that I also tested visually the results with the Radius Networks SDK using its iOS app, which gave similar results as the Estimote SDK
  • 3 different positioning schemes for the beacons
Beacon 1 Beacon 2 Beacon 3
Scheme 1

3.3m

3.23m

3.6m

Scheme 2

3.05m

5.64m

1.52m

Scheme 3

2.92m

1.88m

6.02m


Test Results


In all tests, the standard deviation of the distance evaluated by the iOS device is smaller than by the Android device. That means that the distance calculated by the iOS device is more stable than by the Android device. 

However, with both receiver devices the measured distance is still far away from the actual distance, as can be seen on the below extracts.

/wp-content/uploads/2014/04/cature2_443239.jpg

Figure 1 iOS and Android test result1


In addition, as shown on the below figures, the measured distance could be greater than the actual distance or vice versa.

/wp-content/uploads/2014/04/cature3_443240.jpg

Figure 2 – iOS and Android test result2

A further idea was to understand whether we could get a more precise or trustable measure in a certain range of distances.  I could not prove that. The following charts plot the actual distance and the average of the measured distance using Estimote beacons in this case. The measured distance goes up and down as the actual distance increases.

Capture4.PNG

Figure 3 Data correlation

Trilateration

In my test application, I use trilateration for the implementation, which is the same technique used in a Global Positioning System (GPS). In a nutshell, trilateration is a geometry method to determine your position based on the physical position and relative distances of three referenced points. There are 3 conditions:

  • Trilateration works with 3 or more beacons
  • Beacon signal strength must be stable
  • Each beacon’s signal must intersect with the other two

The practical implementation requires a good deal of mathematics. Again, if there is interest, my colleagues or I can post more about this. 

Test Application

Here is a screenshot of the trilateration test application which runs on Android devices. It displays a floor plan of our office in Montreal. The screen representation is proportional to the actual floor plan. Three Estimote beacons are installed in the room in a fixed position. The signal from each beacon covers the entire room. For this little testing, that means that the condition of having intersection is more than fulfilled, since the 3 signals are superimposed. The app itself was developed using the Estimote SDK.

Capture5.PNG

Normally, the working conditions should be correct, and we should see the red dot moving as we walk around. Unfortunately, that is not the case. The red dot didn’t move most of the time due to the fact that the signal strength of the beacons was not stable at all. The relative distance reported by the app was extremely small even though the physical distance between the device and the beacon was large (a few meters). I also verified separately that repeat experiments in the same conditions measured different signal strengths. 

Summary


Based on these results and the current technology we’ve concluded that beacons are best fit for proximity detection rather than precise location coordinates. For example, you can tell if a person is in a meeting room but not what seat they are sitting at. This still makes them very useful for many indoor location related use cases where you need to Presence rather than Positioning.

To report this post you need to login first.

13 Comments

You must be Logged on to comment or reply to a post.

  1. Wenjun Zhu Post author

    Forget to mention in the post. Special thanks to my manager Nolwen mahe and my colleagues Stephen Petschulat and Marius Cismas for helping me to proofread and organize the content. 

    (0) 
    1. John Astill

      Thanks for the great summary. We are also looking at that exact scenario. Our hopes that were with trilateration the accuracy would be better. We of course also need 3d as a building has more than one floor.

       

      We are still looking at ways to achieve indoor location awareness and are always open for more ideas.

       

      JohnA

      (0) 
      1. Wenjun Zhu Post author

        Hi John,

         

        My colleagues and I had a few emails exchange with some tech guys from Qualcomm. They said the Series 20 Gimbal beacon is more accurate and stable than Series 10. They will ship me one to test. I will let you know how it goes once I receive the beacon.

         

        Wenjun

        (0) 
        1. Nolwen Mahe

          Actually, discriminating between the floors is pretty much an open problem at this point, right, Wenjun?  Here, we observed that we would detect beacons on another floor as well as on our own.  Over to you, I will gladly be contradicted.

          (0) 
  2. Richard Kim

    Hi Wenjun,

    First of all, thank you very much for sharing your experience! My collegues and I were trying to implement triangulation/trilateration on Beacon with Android devices to test the indoor positioning using Estimote Beacons. However, the result wasn’t successful. [removed by Moderator]

     

    Thank you,

     

    Richard Kim [removed by Moderator]

    (0) 
    1. Wenjun Zhu Post author

      Hi Richard,

       

      Thanks for your interest. I am more than happy to answer your questions. [removed by Moderator]

       

      Cheers,

      (0) 
  3. Ronak Patel

    Hello Wen jun,

     

    Thanks for sharing this interesting article. Your experiment is truly comprehensible for a newbie like me.

     

    Based on the summary, I still believe that people would be more excited to see “PRECISE DETECTION” rather than the idea of “PROXIMITY DETECTION”.


    Consider the case of a person in a shopping complex, you can tell that he is inside; however, the need to know his exact location would surely be a rewarding user experience. This is what I would call “Intelligent Adaptation”.

     

    I am just sharing my viewpoint.

     

    Regards,

    Ronak

    (0) 
  4. Ahmed Shehata

    Hello Wenjun,

     

    Thanks for your detailed article it really helped us a lot.

     

    We are currently doing something very similar to what you did here: Trilateration + Estimote beacons and the results are not very satisfying due to the noise in the signal coming from the beacons, the positioning is not very accurate.

     

    I have learned from your previous comments that you will be trying the Qualcomm Series 20 beacons, if so, did you reach any good results?

     

    Regards,

    Ahmed

    (0) 
    1. Wenjun Zhu Post author

      Hi Ahmed,

       

      I received Qualcomm Series 20 beacons. I didn’t have a chance to test it. I will let you know if I get the result.

       

      Regards,

      Wenjun

      (0) 
  5. neelima y

    Hello Wenjun Zhu,

    Thanks for your post. I’m doing thesis about the iBeacons and I like the idea that you have implemented. I would really appreciate if you can post the trilateration implementation to determine the user location just using the Estimote SDK. Looking forward for your reply.

    Thanks,

    Neelima

    (0) 

Leave a Reply