[Impeller] Imparity of blur result with MaskFilter.blur in custom painter with skia on master

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce

clone https://github.com/junaid1460/flutter_imeller_reported_bugs
This project has old reported issues as well, but tabbed to show it. choose mask blur tab

Repeat step to with with and without --no-enable-impeller

Expected results

Actual results

Code sample
Code sample
import 'package:flutter/material.dart';

class CustomPaintMaskBlur extends StatefulWidget {
  const CustomPaintMaskBlur({super.key});

  @override
  State<CustomPaintMaskBlur> createState() => _CustomPaintMaskBlurState();
}

class _CustomPaintMaskBlurState extends State<CustomPaintMaskBlur> {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
        appBar: AppBar(
          title: const Text('Custom Paint Mask Blur'),
        ),
        body: SizedBox.expand(
          child: CustomPaint(
            painter: _ExamplePainter(),
          ),
        ));
  }
}

class _ExamplePainter extends CustomPainter {
  @override
  void paint(Canvas canvas, Size size) {
    Path path_0 = Path();
    path_0.moveTo(size.width * 0.4969963, size.height * 0.2225648);
    path_0.cubicTo(
        size.width * 0.3010403,
        size.height * 0.2494297,
        size.width * 0.2630477,
        size.height * 0.4639523,
        size.width * 0.2850391,
        size.height * 0.6040218);
    path_0.cubicTo(
        size.width * 0.2850391,
        size.height * 0.6892674,
        size.width * 0.2085379,
        size.height * 0.6246876,
        size.width * 0.1895880,
        size.height * 0.7013233);
    path_0.cubicTo(
        size.width * 0.1706381,
        size.height * 0.7779591,
        size.width * 0.3566271,
        size.height * 0.8106794,
        size.width * 0.6528056,
        size.height * 0.7762360);
    path_0.cubicTo(
        size.width * 0.9489841,
        size.height * 0.7417940,
        size.width * 0.7405367,
        size.height * 0.5954106,
        size.width * 0.7398350,
        size.height * 0.4051119);
    path_0.cubicTo(
        size.width * 0.7391333,
        size.height * 0.2148145,
        size.width * 0.7419401,
        size.height * 0.1889823,
        size.width * 0.4969963,
        size.height * 0.2225648);
    path_0.close();

    final paint = Paint()
      ..maskFilter = const MaskFilter.blur(BlurStyle.normal, 164.0)
      ..shader = LinearGradient(
        colors: [
          const Color(0xff00AF54).withOpacity(0.3),
          const Color(0xffFFE972).withOpacity(0.3)
        ],
        begin: Alignment.topLeft,
        end: Alignment.bottomRight,
      ).createShader(Rect.fromLTWH(0, 0, size.width, size.height));

    canvas.drawPath(path_0, paint);
  }

  @override
  bool shouldRepaint(covariant CustomPainter oldDelegate) {
    return false;
  }
}

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel master, 3.11.0-14.0.pre.59, on macOS 13.1 22C65 darwin-arm64, locale en-IN)
    • Flutter version 3.11.0-14.0.pre.59 on channel master at /Users/mj/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision bca7644070 (16 hours ago), 2023-05-27 15:40:24 -0400
    • Engine revision b1698020bd
    • Dart version 3.1.0 (build 3.1.0-155.0.dev)
    • DevTools version 2.23.1

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
    • Android SDK at /Users/mj/Library/Android/sdk
    • Platform android-33, build-tools 33.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.15+0-b2043.56-8887301)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14E222b
    • CocoaPods version 1.12.1

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2022.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.15+0-b2043.56-8887301)

[✓] Android Studio (version 2021.3)
    • Android Studio at /////////
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)

[✓] IntelliJ IDEA Community Edition (version 2022.2.1)
    • IntelliJ at /Applications/IntelliJ IDEA CE.app
    • Flutter plugin version 69.0.5
    • Dart plugin version 222.3739.24

[✓] VS Code (version 1.78.2)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.64.0

[✓] Connected device (4 available)
-----

[✓] Network resources
    • All expected network resources are available.

xref: https://github.com/flutter/flutter/issues/127013#issuecomment-1566091187

I have a similar CustomPaint shape in my project, but in my case I also apply canvas.rotate to the shape. If MaskFilter.blur is applied using Impeller combined with rotation, some weird glitching happen.

Skia, no rotation

Impeller, no rotation

Skia, canvas.rotate(0.2)

Impeller, canvas.rotate(0.2)

Impeller, canvas.rotate(0.27)

canvas.rotate(0.3) make the shape disappear completely with Impeller.
Using negative values for rotate get some weirdness until it disappears around canvas.rotate(-2);
Let me know if a detailed report would help.

flutter doctor

[✓] Flutter (Channel stable, 3.13.0, on macOS 13.2.1 22D68 darwin-arm64, locale en-GE)
    • Flutter version 3.13.0 on channel stable at /Users/agladyshev/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision efbf63d9c6 (8 days ago), 2023-08-15 21:05:06 -0500
    • Engine revision 1ac611c64e
    • Dart version 3.1.0
    • DevTools version 2.25.0

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.2)
    • Android SDK at /Users/agladyshev/Library/Android/sdk
    • Platform android-33, build-tools 33.0.2
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 14.3.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14E300c
    • CocoaPods version 1.12.0

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] VS Code (version 1.81.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.70.0

[✓] Connected device (4 available)
    • CPH2465 (mobile)        • aac06da7                             • android-arm64  • Android 13 (API 33)
    • iPhone 13 mini (mobile) • 62BEDD3B-F627-44FF-8ABC-FDCDE20216A5 • ios            •
      com.apple.CoreSimulator.SimRuntime.iOS-16-4 (simulator)
    • iPhone 14 (mobile)      • 1D25EBA8-F6E3-4EF2-A0A9-F97C03BD9D4A • ios            •
      com.apple.CoreSimulator.SimRuntime.iOS-16-4 (simulator)
    • Chrome (web)            • chrome                               • web-javascript • Google Chrome 113.0.5672.126

[✓] Network resources
    • All expected network resources are available.

To point out this is still not solved here screenshots from latest master for reference
[Impeller]

[Skia]

➜  test git:(master) ✗ flutter --version
Flutter 3.14.0-12.0.pre.78 • channel master • https://github.com/flutter/flutter.git
Framework • revision 6dae269881 (79 minutes ago) • 2023-08-29 00:22:24 -0400
Engine • revision c7c61ff973
Tools • Dart 3.2.0 (build 3.2.0-118.0.dev) • DevTools 2.26.2

Also feel free to reach out to me before release if needed a testing eye, I can test out on my app, fairly large codebase

Any update on this fix?

I captured this in the frame debugger.  What we learned from that is that it is really drawing something.  I'm not sure why the colors are so much more saturated in the frame debugger.  Even where it should be white, it is pinkish.

If the blur sigma is dropped to 1.0, skia and impeller look identical.  The difference in implementation appears to be solely a result of the blur logic and what happens when there is a large sigma.
I also tried disabling wide gamut, to make sure there wasn't something weird happening there.  That didn't change the issue.

I discussed this a bit with the team.  The fact that the blur algorithm is a bit different than Skia's is known.  We believe we should bring our math in closer alignment with Skia's (within reasonable performance).  Across the board our blurs seem a bit more diffuse right now.
Jonah mentioned there is some know discrepancies.  There is an issue for it here, and here is where you'll find the code.

I looked at this a bit more, here is the diff between skia and impeller on a black background so it's easier to see:
impeller

skia

diff

We have a longer term fix for this in https://github.com/flutter/flutter/issues/131580
In the meantime it was postulated by @bdero that the way we are scaling things down on a curve but not scaling down the kernel is leading to the differences in blurring.  We could try to come up with a curve for the kernel size as a quick fix to what we already have.  As a test I scaled the sigma by .5 and it started to look more like skia.  For smaller sigmas it is definitely wrong.  So I think it's promising to try to scale the kernel for now.
impeller (sigma * 0.5)

skia (sigma * 1.0)


MAXTRANSFERSIZE

Description of the feature
For SQLServer 2016 instances with TDE and AOAG, the compress parameter does not actually work. There is very little compression done while burning up CPU. The maxtransfersize parameter needs to be set to 131072 (128K) to enable significant compression.  Can thsi feature be included in the backup script.
Best
C.N. Chamberlain

Ok, I actually reviewed the script and the feature/requested parameter  is already there.  Sorry for requesting before checking.
Best
C.N. Chamberlain

Closing


[Request] Open process by ID

This would help fix the "Not showing all processes" bug, by letting the user find the PID in cheat engine or something.

If ReClass.NET doesn't display a process it will not be able to open it even if you provide the process id. Do you have an example for such a process?

This sounds like PEBKAC to me. I’ve tried protected and manually mapped processes and I could still see them so long as they were actually running. Knocker if you want an example of a manually mapped EXE blackbone has a test project included with it that manually maps Notepad.exe in to the Windows execution space.


[BUG] Incorrect handle of NextLink URL for resourcemanager.compute.fluent.VirtualMachinesClient with filter of virtualMachineScaleSet

Describe the bug
We are currently using resourcemanager.compute.fluent.VirtualMachinesClient to listinstances. We added a filter for virtualMachineScaleSets using the $filter query param, see below:
    val filterByVmss =
      s"'virtualMachineScaleSet/id' eq " +
      s"'/subscriptions/${subscriptionID}/resourceGroups/${resourceGroup}" +
      s"/providers/Microsoft.Compute/virtualMachineScaleSets/${vmssName}'"

    val vmInstances = vmClient.listByResourceGroup(
      resourceGroup,
      filterByVmss,
      null,
      Context.NONE
    )

When the VM list has more than 50 vms and needs Pagination, the response will include a "NextLink", however the SDK sends the second paging request containing the unescaped characters from the "NextLink", and gets rejected by the server.
Example of unescaped URL (this is the request of the second page, notice the unescaped space character, ' eq '):
{"az.sdk.message":"HTTP request","method":"GET","url":"[https://management.azure.com:443/subscriptions/xxxxxx-xxxx-xxxx-xxxx-xxxxx/resourceGroups/xxxxx/providers/Microsoft.Compute/virtualMachines?api-version=2023-03-01&](https://management.azure.com/subscriptions/xxxxxx-xxxx-xxxx-xxxx-xxxxx/resourceGroups/xxxxx/providers/Microsoft.Compute/virtualMachines?api-version=2023-03-01&)$skiptoken=0408e537-0004-4f45-b0b2-59545b84cb90!/Subscriptions/xxxxxx-xxxx-xxxx-xxxx-xxxxx/ResourceGroups/xxxxx/VMs/C18999B7EF80-HFBE_ADC1368B&$filter='virtualMachineScaleSet/id' eq '/subscriptions/xxxxxx-xxxx-xxxx-xxxx-xxxxx/resourceGroups/xxxxx/providers/Microsoft.Compute/virtualMachineScaleSets/c18999b7ef80-hfbe'"

The error from the server is
com.azure.core.exception.HttpResponseException: Status code 400, "<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<TITLE>Bad Request</TITLE> <META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii">
Bad Request

HTTP Error 400. The request is badly formed.

Ps: the VMSS we use is VMSS flex.
Version:
<groupId>com.azure.resourcemanager</groupId>
<artifactId>azure-resourcemanager</artifactId>
<version>2.12.0</version>

Thanks
Exception or Stack Trace
To Reproduce

Create a VMSS with more than 50 VMs, say 70, this is to make the pagination happen.
Use the VM API to call list by resource group, with the vmss name as the $filter.
See the first page returned successfully, but the second page fails.

Code Snippet
Add the code snippet that causes the issue.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Setup (please complete the following information):
            <groupId>com.azure.resourcemanager</groupId>
            <artifactId>azure-resourcemanager</artifactId>
            <version>2.12.0</version>

If you suspect a dependency version mismatch (e.g. you see NoClassDefFoundError, NoSuchMethodError or similar), please check out Troubleshoot dependency version conflict article first. If it doesn't provide solution for the problem, please provide:

verbose dependency tree (mvn dependency:tree -Dverbose)
exception message, full stack trace, and any available logs

Additional context
Add any other context about the problem here.
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[ ] Bug Description Added
[ ] Repro Steps Added
[ ] Setup information Added

We experienced the similar issue in Golang SDK too, and it's fixed: https://github.com/Azure/azure-sdk-for-go/issues/21291

@weidongxu-microsoft could you please take a look

The nextLink is opaque, and should be fully encoded in response. CRP should have encoded the space around eq.

@yumingqiao You may also try 2.30.0
2.12.0 was more than 1 year old.

@weidongxu-microsoft, both python SDK (Azure CLI uses) and go SDK validates and encodes the nextLink before sending out the request. They work fine.
Python SDK: https://sourcegraph.com/github.com/Azure/azure-sdk-for-python/-/blob/sdk/compute/azure-mgmt-compute/azure/mgmt/compute/v2022_11_01/operations/_operations.py?L16271
Go SDK: https://github.com/Azure/azure-sdk-for-go/blob/0c1dfe5e2c8f27f557e67b39ba8d74618533634d/sdk/azcore/runtime/pager.go#L112

It is clearly documented that nextLink should be fully encoded by backend.
https://github.com/microsoft/api-guidelines/blob/vNext/azure/Guidelines.md#collections-include-nextlink-for-more-results
We need to hear from backend first. I don't want to take the risk that SDK accidently encode a parameter twice because a backend error.

e.g. ARM is totally fine
  "nextLink" : "https://management.azure.com/subscriptions/faa080af-c1d8-40ad-9cce-e1a450ca5b57/resources?%24filter=resourceType+ne+%27Microsoft.Network%2fvirtualNetworks%27&%24top=5&api-version=2022-09-01&%24skiptoken=###"

Hi @XiaofeiCao , could you take a look? This bug has caused us to use excessive VM quota, as we have to query all VMs from the resource group and filter by ourselves.

@XiaofeiCao sounds good to me, thank you. What's the release ETA of this new method?

@XiaofeiCao sounds good to me, thank you. What's the release ETA of this new method?

Sure, next 2.31.0's release is around mid Sep.

@XiaofeiCao Thank you for the effort, let me know once it's released.

@yumingqiao 2.31.0 released with the fix.

reopening as this is still being worked on

Hi @XiaofeiCao @TravisCragg-MSFT , we have switched to use this new API, and it seems working fine for us. Could you let us know what are we still working on in the above comment ^, is there anything we need to concern about? Thanks

@yumingqiao Afaik, there's no further work scheduled for Java SDK.
@TravisCragg-MSFT Do you mean backend fix? Guess we can close this issue, since backend fix is tracked in another one: https://github.com/Azure/azure-rest-api-specs/issues/25640


Python Interactive shift+enter causes threading issue

Steps to cause the bug to occur
from dask.distributed import Client
client = Client()

copy paste this to Python Interactive input terminal and runs fine.
select this in python file and use shift+enter to run and hangs on

~/.../python3.7/threading.py in wait(self, timeout)
    298             else:
    299                 if timeout > 0:
--> 300                     gotit = waiter.acquire(True, timeout)
    301                 else:
    302                     gotit = waiter.acquire(False)

Actual & Expected behavior
It should run fine both ways. This only started to happen with latest update to the python extension.
Your Jupyter and/or Python environment
Please provide as much info as you readily know

Jupyter server running:                       Local
Extension version:                               2019.10.41019 (8 October 2019)
VS Code version:                                1.38.1
Setting python.jediEnabled:               false
Python and/or Anaconda version:     3.7.3 | packaged by conda-forge | (default, Jul  1 2019, 21:52:21) [GCC 7.3.0] (6, 0, 1)
OS:                                                     Linux Manjaro
Virtual environment:                          conda

Developer Tools Console Output
[Extension Host] Info Python Extension: 2019-10-09 15:12:33: Cached data exists getEnvironmentVariables, <No Resource>
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:33: > ~/miniconda3/envs/povmap/bin/python ~/.vscode/extensions/ms-python.python-2019.10.41019/pythonFiles/normalizeForInterpreter.py "from dask.distributed import Clientclient = Client()"
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:33: Submitting code for 38b83203-f6e2-4982-bb2d-f0d3240578b8
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:33: Waiting for jupyter server and web panel ...
2console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:33: Wait for sys info for 38b83203-f6e2-4982-bb2d-f0d3240578b8 0
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:33: Adding hash for 1 = 27c2e10d9b9f with 2 lines
3console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:35: /home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/dashboard/core.py:72: UserWarning: Port 8787 is already in use. Perhaps you already have a cluster running?Hosting the diagnostics dashboard on a random port instead.  warnings.warn("\n" + msg)
4console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:35: Task exception was never retrievedfuture: <Task finished coro=<_wrap_awaitable() done, defined at /home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py:596> exception=RuntimeError('\n        An attempt has been made to start a new process before the\n        current process has finished its bootstrapping phase.\n\n        This probably means that you are not using fork to start your\n        child processes and you have forgotten to use the proper idiom\n        in the main module:\n\n            if __name__ == \'__main__\':\n                freeze_support()\n                ...\n\n        The "freeze_support()" line can be omitted if the program\n        is not going to be frozen to produce an executable.')>Traceback (most recent call last):  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py", line 603, in _wrap_awaitable    return (yield from awaitable.__await__())  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 243, in start    response = await self.instantiate()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 325, in instantiate    result = await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 490, in start    await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 33, in _call_and_set_future    res = func(*args, **kwargs)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 190, in _start    process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/process.py", line 112, in start    self._popen = self._Popen(self)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/context.py", line 291, in _Popen    return Popen(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 35, in __init__    super().__init__(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__    self._launch(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 42, in _launch    prep_data = spawn.get_preparation_data(process_obj._name)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 143, in get_preparation_data    _check_not_importing_main()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 136, in _check_not_importing_main    is not going to be frozen to produce an executable.''')RuntimeError:         An attempt has been made to start a new process before the        current process has finished its bootstrapping phase.        This probably means that you are not using fork to start your        child processes and you have forgotten to use the proper idiom        in the main module:            if __name__ == '__main__':                freeze_support()                ...        The "freeze_support()" line can be omitted if the program        is not going to be frozen to produce an executable.
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:35: /home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/dashboard/core.py:72: UserWarning: Port 8787 is already in use. Perhaps you already have a cluster running?Hosting the diagnostics dashboard on a random port instead.  warnings.warn("\n" + msg)
9console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:35: Task exception was never retrievedfuture: <Task finished coro=<_wrap_awaitable() done, defined at /home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py:596> exception=RuntimeError('\n        An attempt has been made to start a new process before the\n        current process has finished its bootstrapping phase.\n\n        This probably means that you are not using fork to start your\n        child processes and you have forgotten to use the proper idiom\n        in the main module:\n\n            if __name__ == \'__main__\':\n                freeze_support()\n                ...\n\n        The "freeze_support()" line can be omitted if the program\n        is not going to be frozen to produce an executable.')>Traceback (most recent call last):  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py", line 603, in _wrap_awaitable    return (yield from awaitable.__await__())  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 243, in start    response = await self.instantiate()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 325, in instantiate    result = await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 490, in start    await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 33, in _call_and_set_future    res = func(*args, **kwargs)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 190, in _start    process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/process.py", line 112, in start    self._popen = self._Popen(self)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/context.py", line 291, in _Popen    return Popen(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 35, in __init__    super().__init__(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__    self._launch(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 42, in _launch    prep_data = spawn.get_preparation_data(process_obj._name)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 143, in get_preparation_data    _check_not_importing_main()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 136, in _check_not_importing_main    is not going to be frozen to produce an executable.''')RuntimeError:         An attempt has been made to start a new process before the        current process has finished its bootstrapping phase.        This probably means that you are not using fork to start your        child processes and you have forgotten to use the proper idiom        in the main module:            if __name__ == '__main__':                freeze_support()                ...        The "freeze_support()" line can be omitted if the program        is not going to be frozen to produce an executable.
console.ts:137 [Extension Host] Info Python Extension: 2019-10-09 15:12:35: Task exception was never retrievedfuture: <Task finished coro=<_wrap_awaitable() done, defined at /home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py:596> exception=RuntimeError('\n        An attempt has been made to start a new process before the\n        current process has finished its bootstrapping phase.\n\n        This probably means that you are not using fork to start your\n        child processes and you have forgotten to use the proper idiom\n        in the main module:\n\n            if __name__ == \'__main__\':\n                freeze_support()\n                ...\n\n        The "freeze_support()" line can be omitted if the program\n        is not going to be frozen to produce an executable.')>Traceback (most recent call last):  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py", line 603, in _wrap_awaitable    return (yield from awaitable.__await__())  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 243, in start    response = await self.instantiate()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 325, in instantiate    result = await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 490, in start    await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 33, in _call_and_set_future    res = func(*args, **kwargs)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 190, in _start    process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/process.py", line 112, in start    self._popen = self._Popen(self)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/context.py", line 291, in _Popen    return Popen(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 35, in __init__    super().__init__(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__    self._launch(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 42, in _launch    prep_data = spawn.get_preparation_data(process_obj._name)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 143, in get_preparation_data    _check_not_importing_main()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 136, in _check_not_importing_main    is not going to be frozen to produce an executable.''')RuntimeError:         An attempt has been made to start a new process before the        current process has finished its bootstrapping phase.        This probably means that you are not using fork to start your        child processes and you have forgotten to use the proper idiom        in the main module:            if __name__ == '__main__':                freeze_support()                ...        The "freeze_support()" line can be omitted if the program        is not going to be frozen to produce an executable.Task exception was never retrievedfuture: <Task finished coro=<_wrap_awaitable() done, defined at /home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py:596> exception=RuntimeError('\n        An attempt has been made to start a new process before the\n        current process has finished its bootstrapping phase.\n\n        This probably means that you are not using fork to start your\n        child processes and you have forgotten to use the proper idiom\n        in the main module:\n\n            if __name__ == \'__main__\':\n                freeze_support()\n                ...\n\n        The "freeze_support()" line can be omitted if the program\n        is not going to be frozen to produce an executable.')>Traceback (most recent call last):  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py", line 603, in _wrap_awaitable    return (yield from awaitable.__await__())  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 243, in start    response = await self.instantiate()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 325, in instantiate    result = await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 490, in start    await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 33, in _call_and_set_future    res = func(*args, **kwargs)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 190, in _start    process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/process.py", line 112, in start    self._popen = self._Popen(self)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/context.py", line 291, in _Popen    return Popen(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 35, in __init__    super().__init__(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__    self._launch(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 42, in _launch    prep_data = spawn.get_preparation_data(process_obj._name)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 143, in get_preparation_data    _check_not_importing_main()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 136, in _check_not_importing_main    is not going to be frozen to produce an executable.''')RuntimeError:         An attempt has been made to start a new process before the        current process has finished its bootstrapping phase.        This probably means that you are not using fork to start your        child processes and you have forgotten to use the proper idiom        in the main module:            if __name__ == '__main__':                freeze_support()                ...        The "freeze_support()" line can be omitted if the program        is not going to be frozen to produce an executable.Task exception was never retrievedfuture: <Task finished coro=<_wrap_awaitable() done, defined at /home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py:596> exception=RuntimeError('\n        An attempt has been made to start a new process before the\n        current process has finished its bootstrapping phase.\n\n        This probably means that you are not using fork to start your\n        child processes and you have forgotten to use the proper idiom\n        in the main module:\n\n            if __name__ == \'__main__\':\n                freeze_support()\n                ...\n\n        The "freeze_support()" line can be omitted if the program\n        is not going to be frozen to produce an executable.')>Traceback (most recent call last):  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/asyncio/tasks.py", line 603, in _wrap_awaitable    return (yield from awaitable.__await__())  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 243, in start    response = await self.instantiate()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 325, in instantiate    result = await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/nanny.py", line 490, in start    await self.process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 33, in _call_and_set_future    res = func(*args, **kwargs)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/site-packages/distributed/process.py", line 190, in _start    process.start()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/process.py", line 112, in start    self._popen = self._Popen(self)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/context.py", line 291, in _Popen    return Popen(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 35, in __init__    super().__init__(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__    self._launch(process_obj)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/popen_forkserver.py", line 42, in _launch    prep_data = spawn.get_preparation_data(process_obj._name)  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 143, in get_preparation_data    _check_not_importing_main()  File "/home/nuno/miniconda3/envs/povmap/lib/python3.7/multiprocessing/spawn.py", line 136, in _check_not_importing_main    is not going to be frozen to produce an executable.''')RuntimeError:         An attempt has been made to start a new process before the        current process has finished its bootstrapping phase.        This probably means that you are not using fork to start your        child processes and you have forgotten to use the proper idiom        in the main module:            if __name__ == '__main__':                freeze_support()                ...        The "freeze_support()" line can be omitted if the program        is not going to be frozen to produce an executable.

While working with dask, there are more new locks in the line gotit = waiter.acquire(True, timeout) that didn't occur with the previous version.
Was there a major change to threads with the latest python version?
Across my testing I always used the same dask version: 2.5.2.

Sorry but threading has nothing to do with our code, it would be changes in python itself (not sure if you're asking about us or python).

Maybe the term threading is not correct on my side, just using because of the traceback of where the code freezes. Still, can you try to reproduce? Is quite easy and as I said, the python, jupyter and dask version do not change, only the python extension. I installed the previous python extension version and all works fine. Run the code in ipython or jupyter, no problem. This is really tied to the update of the extension to enable .ipynb editing because it is tied to running through shift+enter

Did anynone manage to reproduce this issue? For me it's really just 2 lines with dask and latest python extension version and things freeze. Thanks

Yes it hangs for me as well. It hangs from the input box too. And it didn't hang on a previous version.
Not knowing anything about dask, I would guess it's some of startup code. That's recently changed. Although I tried removing all of our startup code and it had no effect.
I would hazard a guess you're hitting this:
https://github.com/dask/distributed/issues/2414
It might have just been lucky that it worked before as the timing around our startup has changed as well.

Thank you for looking into this. Your guess seems reasonable.
How can I experiment with the startup code/timings to try to narrow down where this issue is occurring? Then it becomes easier to involve dask or others necessary.

You could try starting the jupyter notebook yourself, and then set it in our 'Select Jupyter Server URI' command. This significantly changes what we do under the hood.
If that still hangs, then I'm afraid there's nothing else you can change personally without modifying our source code. I guess I'd try debugging dask to see why it hangs.

@mgsnuno, thanks for the input. We've done a bunch of investigation on this and we believe this is something on the dask side that's causing this problem. The reason it may work on older builds is because our theory is is that the bug is timing dependent. It may happen more or less consistently depending on the build of the extension.  We would have to debug dask to figure out what's happening.

You could try starting the jupyter notebook yourself, and then set it in our 'Select Jupyter Server URI' command. This significantly changes what we do under the hood.
If that still hangs, then I'm afraid there's nothing else you can change personally without modifying our source code. I guess I'd try debugging dask to see why it hangs.

Asking dask about this (https://github.com/dask/dask/issues/5525), but for reference I tried your option and still fails. By running directly on the ipython console no problem, it is something that changed with the latest python extension and how the code is sent to jupyter.


remove warnings

remove warning in clang 14 and fix potential bug.

+1, please go ahead with this patch (but the hash mismatches do need to be fixed - how have they appeared?)

+1, please go ahead with this patch (but the hash mismatches do need to be fixed - how have they appeared?)
yes. xiaotiaon might check this issue.


MachineName is invalid when using localhost

I'm using <IP_ADDRESS> as the ip for NCache server.
The NCache service starts but then when I try to run "listcaches.exe", I get this error:
Alachisoft (R) NCache Utility ListCaches. Version 4.6 SP3
Copyright (C) Alachisoft 2017. All rights reserved.
Error: MachineName value  is invalid.
Alachisoft.NCache.Runtime.Exceptions.ManagementException: MachineName value  is invalid. ---> System.ArgumentException: MachineName value  is invalid.
at System.ServiceProcess.ServiceController..ctor(String name, String machineName)
at Alachisoft.NCache.ServiceControl.ServiceControl..ctor(String machine, String service)
at Alachisoft.NCache.ServiceControl.ServiceBase.Start(TimeSpan timeout, String service)
--- End of inner exception stack trace ---
at Alachisoft.NCache.ServiceControl.ServiceBase.Start(TimeSpan timeout, String service)
at Alachisoft.NCache.ServiceControl.CacheService.Start(TimeSpan timeout)
at Alachisoft.NCache.Management.ServiceControl.RPCService.TryIntializeServer(TimeSpan timeout)
at Alachisoft.NCache.Management.ServiceControl.RPCService.GetCacheServer(TimeSpan timeout)
at Alachisoft.NCache.Tools.ListCaches.ListCachesTool.Run(String[] args)

Hi @gigi81,
The command line tool List caches provides some switches, you can see their details by running the following command
listcaches /?
Using '/s' you can specify the machine address on which you want to see all the configured caches.
Please run your listcaches command like this
listcaches /s <IP_ADDRESS>
I just tested it at my end and worked just fine. Moreover, it is not recommended from our side to keep NCache Service running on the IP <IP_ADDRESS>
Please let me know if this worked for you

Specifying the /s switch fixed the problem.
Correct me if I'm wrong, I guess this tool by default doesn't get the ip from the client.ncconf file but uses the machine ip adress, so the error.
I'm closing this now.
Thanks


--detailed-exit-code breking "helm apply"

Versions
Helm
Client: &version.Version{SemVer:"v2.9.1", GitCommit:"20adb27c7c5868466912eebdf6664e7390ebe710", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.9.1", GitCommit:"20adb27c7c5868466912eebdf6664e7390ebe710", GitTreeState:"clean"}
Helm diff version
2.9.0+2
Helmfile version
helmfile version v0.40.1
Error
After running helmfile apply I get Error: unknown flag: --detailed-exitcode
I saw in the code that the detailedExitCode flag is hardcoded to "true" in the helmfile apply command section:
releases, errs := executeDiffCommand(c, st, helm, true, c.Bool("suppress-secrets"))
Apparently not all versions of Helm diff have this CLI argument.
Solution
Upgrade Helm client to 2.11 and run helm init --upgrade to upgrade Tiller

@AndreasBieber Thanks for the detailed report and the solution!
I'm still unsure how we should deal with this. Perhaps just making helmfile warn or fail loudly when you tried to run helmfile apply with an older helm? apply isn't really supposed to work without the --detailed-exitcode feature.

@mumoshu I suppose you meant @AndresPineros 😄

@mumoshu I don't think there's anything wrong with having minimum version requirements for the dependencies, specially if they are needed for core functionalities. For me, the only action to take is to document the minimum required version in the Readme.
Documenting that is important because it will increase the user base. Personally, that day I had time so I got to read the source code and investigate a little, but my first thought was "this is broken".

@AndreasBieber My bad! Thanks for pointing it out.
@AndresPineros I'll definitely document the minimum required versions of dependencies, or maybe provide a command to validate the installation. Thanks for your suggestion 👍


Update Sudoku.Core.csproj

Use a relative path for building.

Thanks for your contribution. I have merged the file so I am going to close this request.


Chapter 2 - Labeling text p.59

Page 59, first command:
"$ cat ner/1.txt"
what kinf of command cat is?
i get this error:
'cat' is not recognized as an internal or external command,
operable program or batch file.

This is a shell command. See https://man7.org/linux/man-pages/man1/cat.1.html


Updates to ScopeType element enums

Need to add Project to the ScopeType enum list

The team agreed to follow:
ScopeType Option 1:  Device, GeoRegion, Portfolio, System, Site, Task Project


Improve appearence of y_offset and x_offset in doc

Before

After

It looks inconsistent with  y_min, x_min, y_max, x_max. Is it OK?

I generally prefer math expression over code block for readability in most cases.
How about changing y_min, x_min, y_max, x_max to math expressions instead?

How about changing y_min, x_min, y_max, x_max to math expressions instead?

It is OK.


Option to resize time day and date

🚀 Features

Option to resize clock time, day and date (Closes #121)

Fantastic and rapid work. Much appreciated by many, I am sure. @mlamberts78


Issue with get() method when fetching data from Mongo Model

Hi,
Sorry, for posting this issue over here because I don't know whether exact issue with this mongodb library v3.0.2 or laravel orm v5.3.4
I'am using Illuminate database orm with laravel-mongodb outside laravel framework. Recently I updated both libraries to latest release versions and suddenly I started getting issue with get() when fetching data from collection. Previous version which I was using were laravel database v.5.2.43 and laravel-mongodb v3.0.0
This is the call am using and getting below error.
$getFacebookPosts = \App\Models\Mongo\Facebookpost::where(
    'facebook_account_id', $userDetails['facebook']['id']
)
->where('created_at', '>', $date_from)
->where('created_at', '<=', $date_to)
->get();

php Fatal error: Uncaught Error: Call to a member function all() on array in /var/www/app/vendor/illuminate/database/Eloquent/Builder.php:613 Stack trace: #0 /var/www/app/vendor/illuminate/database/Eloquent/Builder.php(318): Illuminate\Database\Eloquent\Builder->getModels(Array) #1 /var/www/app/lib/App.php(3833): Illuminate\Database\Eloquent\Builder->get() #2 /var/www/app/influencer/partials/facebook-user-details.php(4): App->facebookUserData('15') #3 {main} thrown in /var/www/app/vendor/illuminate/database/Eloquent/Builder.php on line 613

If you are using Laravel 5.3 you need to update composer to install "jensegers/mongodb": ^"3.2"

Hi,
Still getting this error after updating

illuminate database from v5.2.43 to v5.3.16
jenssegers/mongodb from v3.0.0 to v3.1.3

Fatal error: Uncaught Error: Call to a member function all() on array in /var/www/app/vendor/illuminate/database/Eloquent/Builder.php:613 Stack trace: #0 /var/www/app/vendor/illuminate/database/Eloquent/Builder.php(318): Illuminate\Database\Eloquent\Builder->getModels(Array) #1 /var/www/app/vendor/illuminate/database/Eloquent/Model.php(632): Illuminate\Database\Eloquent\Builder->get(Array) #2 /var/www/app/config.php(138): Illuminate\Database\Eloquent\Model::all() #3 /var/www/app/handler.do(3): require('/var/www/app...') #4 {main} thrown in /var/www/app/vendor/illuminate/database/Eloquent/Builder.php on line 613

Still getting this error after updating too.

Yes, only when am using latest release version of illuminate database

@haridarshan you could solve it use method from #1037 before fixed.

@wedgwood
Since am using different components from different frameworks in our project so is it possible to have that fix inside shouldUseCollections method. That will be great when anyone using laravel-mongodb outside laravel framework.

@wedgwood
Hi,
It did work but I have a use case where am fetching data from Mongo and fetch some values from Sql db and in fetched Mongo am updating the value. When doing so, am getting this error
Argument 1 passed to Jenssegers\Mongodb\Query\Builder::__construct() must be an instance of Jenssegers\Mongodb\Connection, instance of Illuminate\Database\MySqlConnection given, called in /var/www/app/vendor/jenssegers/mongodb/src/Jenssegers/Mongodb/Eloquent/Model.php on line 399
Here is what am doing
/**
* Get all running live streams
*/
$getAllLiveStreams = LiveVideoStream::where([
	'status' => 'live'
])->get();

if (! $getAllLiveStreams->isEmpty()) {
	foreach ($getAllLiveStreams as $liveStream) {
		/**
		* Get all subscribed user for topic
		*/
		$getAllSubscribedUserCount = SubscribedUser::select('client_id')->where([
			'topics' => $liveStream->mqtt_topic
		])->count();

		/**
		* Save this count in LiveVideoStream
		*/
		$liveStream->live_viewers = $getAllSubscribedUserCount;
		try {
			$liveStream->save();
		} catch (\Throwable $exception) {
			// do nothing
		}
	}
}


feat: Add rerun-params-changed command line option

Description
This command line options allows to automatically rerun all rules for which parameters have changed.
Fixes #976.
QC

[x] The PR contains a test case for the changes or the changes are already covered by an existing test case.
[x] The documentation (docs/) is updated to reflect the changes or this is not necessary (e.g. if the change does neither modify the language nor the behavior or functionalities of Snakemake).

This PR lacks the test folder ./tests/test_rerun_params_changed as it is ignored by ./.gitignore. I am not sure why that's the case, but I have it locally and I can force add it.

This PR lacks the test folder ./tests/test_rerun_params_changed as it is ignored by ./.gitignore. I am not sure why that's the case, but I have it locally and I can force add it.

Yes, you need to force add it. The .gitignore needs some refinement.

Ok. I've force added the test folder.
This option is about convenience, but not only that. snakemake -R $(snakemake --list-params-changes) runs all rules whose params have changed. snakemake --rerun-params-changed runs all those rules, but also rules that need to run for other reasons. Therefore, it's an option one can use in each execution of Snakemake. In my workflow, I don't see a reason why I would not have this option enabled all the time.

Ok. I've force added the test folder.
This option is about convenience, but not only that. snakemake -R $(snakemake --list-params-changes) runs all rules whose params have changed.

Actually not, -R only forces the given files, the rest of the workflow is executed as well if necessary. Nevertheless, I agree that it might be a reasonable functionality for convenience, for some even a good default.

Still needs formatting with black.

Sounds good to me and yes, I can do that but will need some time.

I have now started to work on this, and actually decided to make these reruns the default. Using --touch, one always has a way to force ignoring such triggers. Hence, closing this in favor of #1663.

Thanks a lot for your help here and the initial work!

I am glad to hear that. Sorry for never finding the time to finish this. I am looking forward to testing this.


"viewcontroller" no longer provided to AdMob custom event adapter requestAdWithSize()

Hello. I am upgrading from iOS SDK 3.5.4 to 3.6.1 and during testing I discovered that there has been a breaking change to Custom Event Adapters on iOS and my Google AdMob adapter would no longer display banner ads.
The issue is that viewcontroller is no longer part of the NSDictionary parameter passed to Custom Event Adapter's requestAdWithSize() method. This results in the AdMob GADRequest failing with the following error:
<Google> You must set the rootViewController property of <GADInternalBannerView: 0x103364250; frame = (0 0; 320 50); clipsToBounds = YES; autoresize = W+H; layer = <CALayer: 0x283d79f20>> before loading a request.

Inspecting contents of the NSDictionary showed that the parent entry is an instance of MobFoxAd, so as a work-around, passing that object to GADBannerView.rootViewController seems to work just fine. Is this your new recommended solution?
For completeness here is the contents of the NSDictionary being passed to the Custom Event Adapter's requestAdWithSize() method as of iOS SDK 3.6.1:
{
    "adspace_height" = 50;
    "adspace_width" = 320;
    "c_customevents" = 1;
    "c_mraid" = 2;
    "dev_js" = 1;
    "o_iosadvid" = "D07DFB30-3252-4273-BCF6-4597AA759BC1";
    parent = "<MobFoxAd: 0x103b2fde0; frame = (47 686; 320 50); layer = <CALayer: 0x280381860>>";
    rt = "iphone_app";
    s = 9d46ae5307027e30b77fc88046f8a084;
    skip = 0;
    "sub_bundle_id" = "com.snowleopardgames.lifetotal";
    subid2 = LifeTotal;
    subid3 = "com.snowleopardgames.lifetotal";
    subid4 = "2.0.0";
    u = "Mozilla/5.0 (iPhone; CPU iPhone OS 12_1_4 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/16D57";
    v = "3.6.1_core";
}

And the same dictionary using iOS SDK 3.5.4:
{
    "adspace_height" = 50;
    "adspace_width" = 320;
    "c_customevents" = 1;
    "c_mraid" = 2;
    "dev_js" = 1;
    "o_iosadvid" = "D07DFB30-3252-4273-BCF6-4597AA759BC1";
    parent = "<MobFoxAd: 0x1051466e0; frame = (47 686; 320 50); layer = <CALayer: 0x2839e06a0>>";
    rt = "iphone_app";
    s = 9d46ae5307027e30b77fc88046f8a084;
    skip = 0;
    "sub_bundle_id" = "com.snowleopardgames.lifetotal";
    u = "Mozilla/5.0 (iPhone; CPU iPhone OS 12_1_4 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/16D57";
    v = "3.5.4_core";
    viewcontroller = "<MainViewController: 0x1051094b0>";
}

Assuming this isn't a bug, please take care to address breaking issues such as this in future release notes. Thank you!

Upon further testing of the same issue with my custom event adapter for Amazon MobAds on iOS, the same issue came up but the work-around I suggested above proved to be incorrect.
Using the value of parent as the root view controller is a bad idea, since MobFoxAd isn't actually a UIViewController. In the case of Amazon MobAds, this results in a crash because MobFoxAd doesn't handle the selector -interfaceOrientation.
Some more Googling led me to use this code to determine my app's root view controller and pass it on to both AdMob and MobAds in my custom event adapters:
[[[[UIApplication sharedApplication] delegate] window] rootViewController];


Add pySonde

Insert URLs to the project here:
https://github.com/observingClouds/pysonde

[x] The projects is active, documented, open source licensed, shows usage from external parties and is directly targeting environmental sustainability. Find more details in the Contribution Guide.

All issues labeled as 'Good First Issue' of the project listed on OpenSustain.tech will be visible on ClimateTriage.com. This is a great way to welcome new community members to your project.

@observingClouds


[Windows ARM64] BinaryFormatter decode warnings when building dotnet projects

I'm seeing this issue pretty consistently using the arm64 build of dotnet sdk, across a variety of projects. It tends to correlate with other problems like builds hanging randomly.
Steps to reproduce
Using the latest .NET 5.0 preview SDK:
> .\dotnet-install.ps1 -Architecture arm64 -Version 5.0.100-preview.6.20318.15
> dotnet new xunit
> dotnet build # no warnings
> dotnet build # produces a warning

Expected behavior
Should build without warnings..
Actual behavior
Produces the warning:
C:\Users\eitsarpa\AppData\Local\Microsoft\dotnet\sdk\5.0.100-preview.6.20318.15\Microsoft.Common.CurrentVersion.targets(2084,5): warning MSB3088: Could not read state file "obj\Debug\net5.0\msbuild-repro.csprojAssemblyReference.cache". Invalid BinaryFormatter stream. [C:\Users\eitsarpa\devel\tests\msbuild-repro\msbuild-repro.csproj]

Environment data
dotnet msbuild /version output: <IP_ADDRESS>007
OS info: Windows 10 build 18363 on Surface Pro X

Possibly related: we may change the format of this file on disk away from BinaryFormatter for #5247. But if there are bigger problems with BinaryFormatter on ARM64, that could impact our IPC as well as this particular warning.

Closing in favor of the runtime bug causing this: https://github.com/dotnet/runtime/issues/39701
We are failing to read the RAR on-disk data because it contains a Hashtable which internally uses ConditionalWeakTable<> during its deserialization and ConditionalWeakTable<> in turn uses dependent handles which have an implementation issue on this platform.


pcdet/ops/iou3d_nms/src/iou3d_cpu.cpp:12:18: fatal error: cuda.h: No such file or directory compilation terminated. error: command 'gcc' failed with exit status 1

I solved the above problem by updating the content in ~/.bashrc, then source ~/.bashrc.
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-10.1/lib64
export PATH=$PATH:/usr/local/cuda-10.1/bin
export CUDA_HOME=/usr/local/cuda-10.1

export C_INCLUDE_PATH=${CUDA_HOME}/include:${C_INCLUDE_PATH}
export CPATH=$CPATH:/usr/local/cuda/include
export LIBRARY_PATH=${CUDA_HOME}/lib64:$LIBRARY_PATH

The third one is export CUDA_HOME=/usr/local/cuda-10.1, instead of export CUDA_HOME=$CUDA_HOME:/usr/local/cuda-10.1


Bump @material-ui/core

Maybe this could be a less specific dependency...

Would #16 work for you?

@cliedeman yes, perfect!

Released as 0.0.5

nice thank you!


VS Code Completion of Provider Types could be more helpful

Bicep version
VS Code 0.3.255
Is your feature request related to a problem? Please describe.
I've encountered several instances where the autocompletion for resource types is not as ueful as it could perhaps be.  These could be seperate issues, but they are related so I'm posting them as one issue.
For longer resource types, code completion starts to become problematic due as the resource names get truncated.
In this first example, I have a long list of options but as they're all truncated to a common prefix, I have no idea what the difference between the options really are

In this second example there are two problems

I've fully completed the Microsoft.Insights/ prefix, however there is a bunch of noise for other Microsoft.*.Insights resources.  Given that I've already fully qualified Microsoft.Insights/, I'd expect suggestions to be limited to Microsoft.Insights/*
This example is a worst case length where at first glance it seems like you have a full api version, but in reality the -preview has been truncated away.

In this third example, I want to provision a storage container, so I type container to get auto completions.  The first several results are overwhelmed by several different versions of ACI / ACR resources, but what I actually want is Microsoft.Storage/storageAccount/blobServices/container - I have to scroll through 10 pages of autocompletion before coming across this.

Describe the solution you'd like
I think the ultimate problem is that bicep is complete the entire resource@version string in a one go - maybe it would make more sense to up the auto completion into a few segments.   My first thought was something like C# where you only complete one segment at a time (e.g. up to the next / or @).   However that removes the explorability of providers were you could just type container and find the fully qualified name Microsoft.Storage/storageAccount/blobServices/container - I imagine something between these two extremes would work.

If you are eager, looks like @TarunSunkaraneni implemented some of this already in an open PR :)
You can download vscode-bicep.vsix from this action run and install it:

Open VSCode.
In the Extensions tab, select the options (...) menu in the top right corner and select 'Install from VSIX'. Provide the path to the  VSIX file you downloaded.
Click "Install".

Two part resource type completion is available in the latest release (v0.3.539) and I must say that it work very well for me.
It is a good improvement

VSCode edit distance algorithm has a mind of its own, and i'd be interested in refining this experience. Would having a ranking system that orders using the longest overlapping string, then ranking by total edit distance be an appropriate solution to this?

Ah, didn't catch that this was quite a scroll down from the obvious completions. The search algorithm used here is VSCode's default logic, which VSCode uses in typescript and probably many other extensions. While i understand that sometimes the matching behavior of VSCode is peculiar, as long as the most logical matches show up at the top of the list it's probably not worth the effort to implement a search algorithm that won't cause regressions


Implements get_executable_path for OS X should proc_pidpath in os_osx…

….mm doesn't succeed. Silences the warning for javascript as the function currently appears superfluous.
If the javascript platform really needs to be implementing this, I'm not exactly sure what the output should be.

Again, please try to write a short (50-60 chars) commit title for your commit log, the detailed description should come after an empty newline.

Code looks good.


Find a way to seamlessly integrate restrictions management

This should be tied together with the new restrictions manager under development for toponav


hot reload not correctly work

[HMR] The following modules couldn't be hot updated: (They would need a full reload!)

Hi, yes it probably needs many updates. Migration to Webpack 2 is needed and others. I'll try to do some updates, but I am not sure when exactly :/


[Feature Request] Does this API support WhatsApp Business?

Not a problem, just out of curiosity.
I need to implement a hybrid api, for official and non-official integration.

That one is an interesting idea, will consider that!

Right now it has much simpler API then official one and we'd love to keep that, but as another API for that it'd be great to be compatible with the official, agree

We could start with sending messages https://developers.facebook.com/docs/whatsapp/cloud-api/guides/send-messages

Something we can start with - implement it the same way https://github.com/clairton/unoapi-cloud


OpenCV wrapper example not converting from RGB to BGR correctly

Required Info

Camera Model
D400

Firmware Version
<IP_ADDRESS>

Operating System & Version
Ubuntu 18.04

Kernel Version (Linux Only)
4.9.140-tegra

Platform
NVIDIA Jetson TX2

SDK Version
v2.31.0

Language
C++

Segment
others

Issue Description
When using the example OpenCV wrapper file cv-helpers.hpp, the function frame_to_mat does not perform a correct conversion from RGB to BGR for OpenCV. This leads to color images used in OpenCV to have swapped blue and red channels.
Between line 25 and 29, the conversion is currently done as such:
else if (f.get_profile().format() == RS2_FORMAT_RGB8)
{
    auto r = Mat(Size(w, h), CV_8UC3, (void*)f.get_data(), Mat::AUTO_STEP);
    cvtColor(r, r, COLOR_RGB2BGR);
    return r;
}

It should be done as such:
else if (f.get_profile().format() == RS2_FORMAT_RGB8)
{
    auto r_rgb = Mat(Size(w, h), CV_8UC3, (void*)f.get_data(), Mat::AUTO_STEP);
    Mat r_bgr;
    cvtColor(r_rgb, r_bgr, COLOR_RGB2BGR);
    return r_bgr;
}

I will try and make a pull request.
Thank you.

Thanks @cedriclmenard


Sprockets 4.2.0: Generates 404 on all assets

Hi,
All my gems are up to date. My frontend packages on the other hand very outdated, however it doesn't matter in the matter of this issue.
The CLI command
bundle exec rake ember:compile

builds by default assets into tmp/ember-cli/apps/frontend/assets and there is some magic that makes
GET http://localhost:3000/assets/vendor.css

possible.
However, starting  with Sprockets 4.2.0, these GET http://localhost:3000/assets/vendor.css makes 404.
Just though I would share in case somebody else hits the same bug.

Hi! I solved this by not loading sprockets at all. In config/application.rb only load what you need and comment sprockets out:
require "rails"
# Pick the frameworks you want:
require "active_model/railtie"
require "active_job/railtie"
require "active_record/railtie"
require "active_storage/engine"
require "action_controller/railtie"
require "action_mailer/railtie"
# require "action_mailbox/engine"
# require "action_text/engine"
require "action_view/railtie"
# require "action_cable/engine"
# require "sprockets/railtie"
require "rails/test_unit/railtie"

You also have to comment out various config options which belongs to the assets pipeline under config/environments/* and config/initializers/assets.rb.


Concurrent access to map in font.go

Font.SubsetID() uses subsetIDMap map[uint16]uint16 (font.go:126).
Concurrent access to maps is disallowed and the race detector highlights this.
Because Font is always accessed through a pointer, it is possible to have rendering issues if multiple goroutines are trying to render separate PDF documents at the same time, when the same font is used for the text.
I noticed this in renderers/pdf/writer.go:849
Typically, what happens is that the rendering works correctly provided that the first goroutine that invokes Font.SubsetID() does so without clashing with any other goroutines using the same Font. Subsequent calls will also succeed because the tendency is to have concurrent cache hits on that subsetIDMap.
From time to time, but very rarely, a stack trace arises in production because an actual clash happened.
Suggestions
The simple solution is to use a sync.Mutex within Fond.SubsetID, but because this method is used within loops, it might not be fast enough to acquire and release the lock on every call. A different API that handles multiple glyph IDs in a batch would mitigate this
One possible lock-free solution might be to do away with the map and just keep the slice subsetIDs []uint16. Finding an existing subset ID would need a linear search through this; however it would be relatively quick because the values are integers so equality comparisons are fast. Adding to the slice would require an atomic.Value swap of the new slice for the old slice.
That said, Font.SubsetID() is called within loops so its performance probably matters.
Another solution might be through sync.Map, although there would then be a need for interface pointers around every glyph ID (keys and values), so this might possibly work out slower than linear searching.
(There may be better solutions.)
Testing
Unfortunately, there don't seem to be unit tests for this part of the font code, nor for the PDF renderer.

Thank you so much for the great and deep analysis of the problem. The subset structure should indeed reside with the renderer and not the font. I've pushed out the changes in the above commit, please let me know your opinion!


Can I force the annyang to parse string word number to actually integer numbers?

Hey, I would like to know if there is some way to force annyang to parse word numbers.
for example: five hundred to 500.
currently it sometime gives me 500 and five hundred.
Expected Behavior
Speaking to mic asking for five hundred
expected to return 500 and not five hundred.
Current Behavior
Sometime return 500 and sometimes return five hundred as word string.

I've had the same problem before and unfortunately this is something that cannot be avoided. Something like this should do the trick:
http://stackoverflow.com/questions/11980087/javascript-words-to-numbers

For another reference, I have come across:
https://github.com/howlowck/words-to-num
And asked if this is a valid implementation in plain javascript:
https://github.com/howlowck/words-to-num/issues/1
There is a working jsFiddle link there.

There isn't a way to force the speech to text engine to return numbers as a numerical representation or as words.
Your best bet would be to parse the results as suggested by @sdawson26 and @oshihirii.


Added a '-seed' option to sample.lua to allow for an identical rerun.…

…  This option seeds the torch RNG with a selected integer value.
Default sample.lua behavior is unchanged - a random value is seeded if the option is omitted or set 0.
The option honours the verbose flag and reports the seed, even the random seed, to permit an identical rerun if required.
Please note - this does not affect the training at all - only the sample.lua

Perfect. I'll resolve your comments and resubmit.
On 13 Mar 2018 5:26 pm, "Chris Cummins"<EMAIL_ADDRESS>wrote:

@ChrisCummins requested changes on this pull request.
Hi @turbotas https://github.com/turbotas, sorry for my slow response.
This looks great, thanks :)
Unfortunately I don't have the ability to run torch-run at the moment,
could someone please checkout this PR and verify it?
I've added a couple of comments for minor issues. Please also add an entry
in docs/flags.md
https://github.com/jcjohnson/torch-rnn/blob/master/doc/flags.md
documenting this new feature.
In sample.lua
https://github.com/jcjohnson/torch-rnn/pull/219#discussion_r174216091:

local opt = cmd:parse(arg)

local checkpoint = torch.load(opt.checkpoint)
local model = checkpoint.model
+if opt.seed == 0 then
What is someone wants to use a -seed 0? Is it possible to check if a flag
is explicitly set? If it is, then you should change the if conditional to
it; if not, then please document that the seed cannot be zero.
In sample.lua
https://github.com/jcjohnson/torch-rnn/pull/219#discussion_r174216980:

local opt = cmd:parse(arg)

local checkpoint = torch.load(opt.checkpoint)
local model = checkpoint.model
+if opt.seed == 0 then

opt.seed = torch.random()
+end
+torch.manualSeed(opt.seed)

Might be simpler to force a manual seed only if -seed argument is set:
if :
torch.manualSeed(...)
end
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jcjohnson/torch-rnn/pull/219#pullrequestreview-103531678,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALi3noGdgmrGPbRau_Df9QsbnD7bv0gjks5teAEqgaJpZM4SaVLD
.

I think I fixed comments and issues at commit 5d952d85189eec0de00fe6af05710f55e6b21106 but not smart enough with git to know if I need to submit a new Pull request.

Thanks @turbotas , yep the PR picked up your new commit.
Can someone please run this branch and let me know it works as expected? It doesn't look like there's much room for anything expected, but would like a second opinion before merging.


Change RELEASE_NOTES.md to ChangeLog

As discussed in https://github.com/Pelican-Elegant/documentation/issues/52, we should change https://github.com/Pelican-Elegant/elegant/blob/master/RELEASE_NOTES.md to change it into a traditional ChangeLog – see Wikipedia article for naming and format convention – and make it a rule that when a new feature or (big) bug is fixed, it should be documented there as well in the same PR.
Then we could simply include the changelog into the release notes, when we write them.

if we use release tagging, 'pbr' module helps into writing it https://pypi.org/project/pbr/

PBR looks quite useful, yes.

Changelog as generated by PBR: https://paste.fedoraproject.org/paste/LCZsJsRBYrVUYj26VPvjeQ
Authors as generated by PBR: https://paste.fedoraproject.org/paste/RG4DANKmSmLg2jPDDePBHQ
If you like it, I can submit PR for adding setup.py and setup.txt so that Changelog and Authors will be created with python setup.py sdist (and then git add and commit)

As I already did it for the test, here it is the PR: https://github.com/Pelican-Elegant/elegant/pull/242

ChangeLog and AUTHORS look good to me, yes.
This would also be a good MVP for #227, and we can change that issue to extend the contribution list.
Thanks for implementing this :)

Do we want for 'once' to rewrite master logs by squashing comments and force overwrite of the branch to rewrite full history and have a working change log after it?

Draft for release notes done from mobile
Please do ammend it
Regards
Pablo
Sent from mobile
El 29 dic. 2018 19:24, "Talha Mansoor"<EMAIL_ADDRESS>escribió:
@iranzo https://github.com/iranzo and @silverhook
https://github.com/silverhook for change log, we must make sure to remove
fluff commits. This won't be necessary if we make sure every PR has
squashed commits.
Secondly, we may still need to review and edit the change log. To clarify
the language and categorize change log into sections (New, Bug fixes,
Breaking changes etc).
But it is a great addition. Thank you @iranzo https://github.com/iranzo.
Our 2.0 release is ready. We are mainly blocked by the announcement article
in documentation. Your contribution will enable us to write release note
quickly.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Pelican-Elegant/elegant/issues/241#issuecomment-450511088,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AATEj9BNJky7erM2oCnEzt7NIhzMRBwPks5u97NOgaJpZM4ZjL1f
.

Draft for release notes made on the mobile...
elegant2 (1).txt

Do we want for 'once' to rewrite master logs by squashing comments and force overwrite of the branch to rewrite full history and have a working change log after it?

Oh please. No. Never. Upstream should never be rebased. Bad things will happen if change the upstream.
But for future, we must make sure commit messages are succinct and explanatory. As for squashing, I have been doing it using Github or from cmd. We do ask contributor to squash the commits in the Contributing doc

Document put in https://github.com/Pelican-Elegant/documentation/pull/56

@iranzo, I gave some feedback in your PR and will also make my draft available (sorry that I didn’t push it sooner and had it lying on the disk), so we can merge the two.
I’m reopening this issue as the ChangeLog is still of non-standard format.

We have added automatic changelog creation on new releases.

Looks great, thanks for setting this up. And I apologise for not replying sooner. Was busy :/

And I apologise for not replying sooner. Was busy

No issues. Good to have you back.


Apply changes in 1000g FTP file names.

@Mehrnaz-Charkhchi i don't think that's the only place that needs changing. The code you changed is just a text description, its not the actual piece of code that does the fetching of the file.  I cant remember where it is exactly but there is also a request in the JS file and probably something in the SiteDefs.pm as well.
Let me know if you cant find it, i can help you with it.

@Mehrnaz-Charkhchi sorry ignore my comment above, i didnt see your other PR in public-plugins.

@Mehrnaz-Charkhchi i don't think that's the only place that needs changing. The code you changed is just a text description, its not the actual piece of code that does the fetching of the file. I cant remember where it is exactly but there is also a request in the JS file and probably something in the SiteDefs.pm as well.
Let me know if you cant find it, i can help you with it.

@ens-ma7 Done!

@Mehrnaz-Charkhchi  The PR is against release/103 branch. You probably want to do the PR against postreleasefix/103 branch but first you need to create your branch from the postreleasefix/103 branch.

@Mehrnaz-Charkhchi The PR is against release/103 branch. You probably want to do the PR against postreleasefix/103 branch but first you need to create your branch from the postreleasefix/103 branch.

@ens-ma7 Source and base branch is updated to postreleasefix/103.

@Mehrnaz-Charkhchi i have approved the change but we still need to fix the issue with the live tools with the 1000Genomes API being down (I understand we are waiting to hear from susan). These changes are just text change, you can still push these changes live but the tools wont be fixed by these.

@ens-ma7 True, I added another commit  with file name updates to help users work with sample files.


v1.4.0

Why not 1.3.1? It's not a feature, it's a bugfix (extra redirect is a bug), isn't it?

It wasn't a bug. GA provided source code without strict https. Yandex metrica too.
But now they provide with.

Well, if we tag it as 1.4.0 users with 1.3.* will not get this update. I think, it's wrong.

@zxqfox what's your opinion?

Well, I guess it's more like patch than minor, since it's not a addition to public API and it fixes broken functionality. ;-)

ok, updated


Fixed and improved help text and defaults of command options

See commit message.

Coverage decreased (-0.02%) to 36.673% when pulling df86d62bc9a69a8c48094dc58a0f3728265752f7 on andy/show-default into bb3e8222b68d78e0dcbd25822502d8bd26f7bf74 on master.


Add permission block to GitHub Action example

Ref https://docs.github.com/en/actions/security-guides/automatic-token-authentication#permissions-for-the-github_token
This is currently failing to create a new branch for me:
name: imgcmp

on:
  push:

jobs:
  build:
    name: Optimize images
    runs-on: ubuntu-latest

    permissions:
      contents: write
      pull-requests: write

    steps:
    - uses<EMAIL_ADDRESS>      env:
        GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

Error:
Error getting current user: Forbidden (HTTP 403)
Resource not accessible by integration

  [fname], Congrats! You've received a Capital One reward
You may unsubscribe any time :         here

  [fname], You have been randomly selected!

You may unsubscribe any time :         here

)

@hazcod
Thank you for reporting this! Unlike two years ago when I created this GitHub Actions, GITHUB_TOKEN did not seem to have enough permissions. Instead, I fixed this actions to use a personal access token.
https://github.com/9sako6/imgcmp#change-log
From the previous version, the interface has changed a bit.


Split main out into a BotManager

This will be the first step towards making a management server

One thing to note, this requires multiple networks to either use a dict format or include an id field. It may be worth using a different name (as id is a builtin) or generating a uuid based on the hostname, host port, username, and password

I also added a swapfile to drone so it doesn't fail when it tries to install lxml any more because of OOMing.

Working on a different rewrite. This isn't a direction I plan on going any more.


pairs_from_retrieval

Hello,
Thank you for your great work.
I have a question about "pairs_from_retrieval.py".
I would like to know please what exactly contains "--descriptors ", "--query_list" and "--db_list "?
For example if I have one query image and n images in my database. Descriptors will be an h5 file containing the global descriptors of query images and n images in the database?
I did the same thing but I still have the following error
Traceback (most recent call last):
File "/gdrive/MyDrive/Hierarchical-Localization/hloc/pairs_from_retrieval.py", line 69, in
main(**args.dict)
File "/gdrive/MyDrive/Hierarchical-Localization/hloc/pairs_from_retrieval.py", line 43, in main
db_desc = tensor_from_names(db_names)
File "/gdrive/MyDrive/Hierarchical-Localization/hloc/pairs_from_retrieval.py", line 39, in tensor_from_names
desc = [hfile[i]['global_descriptor'].array() for i in names]
File "/gdrive/MyDrive/Hierarchical-Localization/hloc/pairs_from_retrieval.py", line 39, in
desc = [hfile[i]['global_descriptor'].array() for i in names]
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
File "/usr/local/lib/python3.6/dist-packages/h5py/_hl/dataset.py", line 506, in getitem
new_dtype = readtime_dtype(self.id.dtype, names)
File "/usr/local/lib/python3.6/dist-packages/h5py/_hl/dataset.py", line 48, in readtime_dtype
raise ValueError("Field names only allowed for compound types")
ValueError: Field names only allowed for compound types
I use https://github.com/yxgeee/OpenIBL to Extract descriptor then i save it to h5 file

Hi,
I am actually planning to integrate OpenIBL at some point but haven't tried it out yet :)
--descriptors is a path to a HDF5 file, as described here. You can create it the following commands:
with h5py.File(path, 'a') as hfile:
    grp = hfile.create_group(image_name)
    grp.create_dataset('global_descriptor', data=desc)

Next, the script needs to know which entries in this HDF5 file are queries or reference images. Two solutions:

if the name of query and ref images have different prefixes (e.g. they are in different subfolders), you can provide them with --query_prefix and --db_prefix (that's the easiest option)
you can provide lists of query and ref images in different text files using --query_list and --db_list. For now they also need intrinsics (possibly faked) and will be parsed by this function, but it would be easy to modify the code to just read image names.

Your error probably comes from incorrect image names (e.g. tuples) - we should add checks to prevent this.

Thank you very much for this answer.
I have a question about the localization  on costum dataset.

But I still had the same error in the last localization step
h5py/_objects.pyx in h5py._objects.with_phil.wrapper()
h5py/_objects.pyx in h5py._objects.with_phil.wrapper()
h5py/h5o.pyx in h5py.h5o.open()
KeyError: 'Unable to open object (component not found)'
Are the steps correct to localize new image in costum dataset ?
Thank you very much

At what line and file is the error raised? The steps look correct but I suspect that there is a problem with image names.

if you called extract_features on images/, then the matching in pipeline_SfM cannot be exhaustive and you need to provide an explicit list of pairs (otherwise it would run SfM on the queries as well). Then pairs_from_retrieval can be run with the prefixes.
if you called extract_features two times, first on images/db/ and then on images/query/, then the image names do not have the db/ and query/ prefixes, and you most likely cannot run pairs_from_retrieval with prefixes.

I suggest that you put your images in two directories images_db/db/ and images_query/query/, first run SfM on images_db/, then localize images in images_query/ using the prefixes db and query for pairs_from_retrieval.

Thank you very much that helped me a lot.

Could you please tell me how (in which function) I can change the camera model before extract_features?
can I use colmap for 3D reconstruction and then apply your localization steps?
thank you very much for your time

You can look at my branch for an example of how to perform image retrieval. The example is in pipeline_SfM.ipynb.
https://github.com/half-potato/Hierarchical-Localization/tree/robotcar

You can look at my branch for an example of how to perform image retrieval. The example is in pipeline_SfM.ipynb.
https://github.com/half-potato/Hierarchical-Localization/tree/robotcar

Closing this issue due to inactivity. Feel free to reopen it.

I am facing a similar issue. I want to run the pipeline_Aachen under Ubuntu 20.04.
My data is structured as follows:
/datasets/my_dataset/images/db
/datasets/my_dataset/images/query
/pairs/my_dataset/pairs_from_my_own_retrieval.txt
/outputs/my_dataset/my_COLMAP_model/*.bin

I run
from pathlib import Path
from pprint import pformat

from hloc import extract_features, match_features, pairs_from_covisibility
from hloc import colmap_from_nvm, triangulation, localize_sfm, visualization

dataset = Path('datasets/my_dataset/')  # change this if your dataset is somewhere else
images = dataset / 'images/'

pairs = Path('pairs/my_dataset/')
sfm_pairs = pairs / 'pairs-db-covis20.txt'  # top 20 most covisible in SIFT model not needed as model is already generated?
loc_pairs = pairs / 'pairs_from_my_own_retrieval.txt'  # top 50 retrieved by my own retrieval

outputs = Path('outputs/my_dataset/')  # where everything will be saved
reference_sfm = outputs / 'sfm_superpoint+superglue'  # the SfM model we will build
results = outputs / 'my_dataset_hloc_superpoint+superglue_retrieval20.txt'  # the result file

# list the standard configurations available
print(f'Configs for feature extractors:\n{pformat(extract_features.confs)}')
print(f'Configs for feature matchers:\n{pformat(match_features.confs)}')

feature_conf = extract_features.confs['superpoint_aachen']
matcher_conf = match_features.confs['superglue']

feature_path = extract_features.main(feature_conf, images, outputs)

pairs_from_covisibility.main(
    outputs / 'TBP_superglue', sfm_pairs, num_matched=20)

print(sfm_pairs)

sfm_match_path = match_features.main(matcher_conf, sfm_pairs, feature_conf['output'], outputs)

I get the error
KeyError: "Unable to open object (object 'df_hauptkatalog_0129217.jpg' doesn't exist)"
and when I check the generated pairs-db-covis20.txt I can see that no db/ or query/ is added in front of my images as for the Aachen example dataset. How would I fix this?
The first line is e.g., df_hauptkatalog_0129217.jpg df_hauptkatalog_0105612.jpg but the images are in /db/df_hauptkatalog_0129217.jpg
For a workaround I try inserting it into pairs_from_covisibility.py line 50.


this is not accessible in some cases for top-level properties

	controlPageOptions: A([
		{ name: this.intl.formatMessage({
			defaultMessage: 'Basic View',
		}), id: 'basic' },
		{ name: this.intl.formatMessage({
			defaultMessage: 'Full View',
		}), id: 'full' },
	]),

app/controllers/account/settings.js

Confirmed this is still an issue. The reason being that Ember classic classes properties don't have correct binding to this, unless they are wrapped in a function or a computed property.
For classic class properties we could probably add a comment instead.


Add faces for spacemacs modes

Before:

After:

Where are these faces defined? I can't find them anywhere in https://github.com/syl20bnr/spacemacs/ or https://github.com/TheBB/spaceline/
As far as I know it depends on https://github.com/syl20bnr/spacemacs/issues/8378

@belak the spacemacs fonts are set dynamically using something like
(intern (format "spacemacs-%s-face" state))

If you search for "spacemacs-%s-face" you should be able to find the places where they are defined.
Setting the spacemacs-normal-face, spacemacs-insert-face etc inside base16-theme-define works fine and it gets restored after you load another theme etc. These faces set what the
The problem is with the cursor settings for evil. Evil expects cursor settings to be set in variables evil-normal-state-cursor etc and they are not faces. They contain the cursor color as well as a cursor-type, which then evil uses to set the face and type of cursor dynamically based on the mode.
If we want the cursor color to be the same as the color of spacemacs state shown in spaceline (or change customize the evil state colors for any other reasons), we must set the "evil-%s-state-cursor" variables.
The solution I have for this currently in my config is to add a hook that updates the cursor colors after load-theme. The hook sets the cursor color based on base16 colors if the theme is base16 or resets them to the default spacemacs colors for any other theme.

Ah, I see. Thanks for the info!


Vulkan SDK <IP_ADDRESS> regression

There's nothing we can do right now, a regression occured in Vulkan SDK <IP_ADDRESS> where the surface creation helper in this library will not work.
Until LunarG release a new SDK, the fix require you to update the vulkan.hpp file in the SDK headers manually following the instructions in this thread : https://github.com/KhronosGroup/Vulkan-Hpp/issues/467
Will close this issue when LunarG updates their SDK with the fix (next version in theory, a few weeks from now.)

SDK <IP_ADDRESS> is out so this is not a problem anymore 🎉


cherry-pick: istio iptables filters empty values

closes https://github.com/istio/istio/issues/25000
This PR only pulls in the iptables gen fix, curious what differences there may be in templates/template-locations for 1.5?
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[X] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure

@stevenctl: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

unit-tests_istio_release-1.5
c3a62bb856e53fd0d739cafbb0f1ded4ac31342f
link
/test unit-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@stevenctl: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

unit-tests_istio_release-1.5
c3a62bb856e53fd0d739cafbb0f1ded4ac31342f
link
/test unit-tests_istio_release-1.5

integ-istioio-k8s-tests_istio_release-1.5
c3a62bb856e53fd0d739cafbb0f1ded4ac31342f
link
/test integ-istioio-k8s-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


This error just appeared today when running "rofi -show emoji -modi emoji"

rofi -version
Version: 1.7.4

rofi-emoji
3.0.1-1

I use the emoji plugin many times throughout the day.
Rofi + rofi-emoji is probably my most used function of my system. :P
After having done some updates today, I noticed that rofi-emoji fails to run.
I have always used this key combo.
super + ctrl + f
  rofi -show emoji -modi emoji

If I run rofi -show emoji -modi emoji directly in the terminal, I get this error:

Can you help me troubleshoot this?

Facing the same issue here.
rofi 1.7.4-1
rofi-emoji 3.0.1-1

Using the full format string works:
rofi -modi emoji -show emoji -emoji-format '{emoji} {name}[ ({keywords})]'

Of course, it should use this format string by default when none is provided.

Similar issue here. I run Rofi from my sxhkdrc file, which is what BSPWM uses for setting keybinds; that said, when running it from there and not a terminal, I get the following:

Similar issue here. I run Rofi from my sxhkdrc file, which is what BSPWM uses for setting keybinds; that said, when running it from there and not a terminal, I get the following:
Edit: @nnsee's suggestion works for me in the terminal (thanks) but doesn't in sxhkd.

Yup.
Mine is similar. Using bspwm on Endeavour OS (Arch based).

sxhkdrc parses { and } symbols directly - they have to be prefixed with a backslash, ie \{emoji\}

Please don't close this issue, it's still broken 😅

sxhkdrc parses { and } symbols directly - they have to be prefixed with a backslash, ie \{emoji\}

Works like a charm, tyvm!

@jjaimealeman Why did you close this? Is it fixed? Please provide solution or re-open the issue.

@jjaimealeman Why did you close this? Is it fixed? Please provide solution or re-open the issue.

DAMN! My apologies.
The issue is not closed. I guess I hit the wrong button.

I will look into this. It should have a default value, and it works for me so I find this very surprising.
I'll get back to you as soon as I manage to reproduce the problem.

I will look into this. It should have a default value, and it works for me so I find this very surprising.
I'll get back to you as soon as I manage to reproduce the problem.

Thanks for looking in to this for us.

Probably cause by some lib update in arch?

Yep. I updated Rofi and now I get it too. They probably changed some of their APIs around with a breaking change.

I recompiled the project and now it just worked. Maybe the problem was just that Rofi wasn't ABI compatible anymore…
I'll raise this issue with the Arch repos. If anyone here could compile from source and test it in order to confirm this, that would be great.

@Mange I can confirm that the error goes away when compiling and installing rofi-emoji from source.
I'm using Arch Linux with the LTS kernel: 5.15.60-1-lts, and rofi 1.7.4.

Thank you. I've emailed the maintainer in Arch to ask for help.
I think they "just" need to recompile and release a new pkgrel version of rofi-emoji in order to fix this.

I can also confirm that compiling and installing rofi-emoji from source has solved the issue.
Kernel Version: 5.19.1-zen1-1-zen
Rofi Version: 1.7.4

I had the same issue and installing rofi-emoji-3.0.1-2 fixed it for me.
I think its safe to close this issue.


automated testing for forking-workflow-exercise is missing if instructor mirrors to own github namespace

i think we used to have coderefinery/forking-workflow-exercise connected to Travis, so that we could see the red/green lights on the PRs.  Probably we should add to instructor notes that the mirrored repo should be connected to travis

Travis setup is mentioned here: https://coderefinery.github.io/git-collaborative/guide/#prepare-exercise-repositories
But maybe needs to be reworded or clarified.


[Bazel6] Avoid copying in .h directories into Foo.framework/Headers

Fix the following mismatch between the declared output and the symlink’d input:
$ bazelisk test --local_test_jobs=1 --apple_platform_type=ios --deleted_packages='' -- //tests/ios/...
…
ERROR: /Users/matt.robinson/Developer/rules_ios/rules_ios/tests/ios/frameworks/intentdefinition/BUILD.bazel:3:16: in apple_framework_packaging rule //tests/ios/frameworks/intentdefinition:ObjCIntentConsumer:
Traceback (most recent call last):
	File "/Users/matt.robinson/Developer/rules_ios/rules_ios/rules/framework.bzl", line 854, column 43, in _apple_framework_packaging_impl
		framework_files = _get_framework_files(ctx, deps)
	File "/Users/matt.robinson/Developer/rules_ios/rules_ios/rules/framework.bzl", line 383, column 38, in _get_framework_files
		header_out = _framework_packaging(ctx, "header", header_in, header_out, framework_manifest)
	File "/Users/matt.robinson/Developer/rules_ios/rules_ios/rules/framework.bzl", line 185, column 45, in _framework_packaging
		_framework_packaging_symlink_headers(ctx, inputs, outputs)
	File "/Users/matt.robinson/Developer/rules_ios/rules_ios/rules/framework.bzl", line 150, column 28, in _framework_packaging_symlink_headers
		ctx.actions.symlink(output = output, target_file = input)
Error in symlink: symlink() with "target_file" directory param requires that "output" be declared as a directory (did you mean to use declare_directory() instead of declare_file()?)
ERROR: /Users/matt.robinson/Developer/rules_ios/rules_ios/tests/ios/frameworks/intentdefinition/BUILD.bazel:3:16: Analysis of target '//tests/ios/frameworks/intentdefinition:ObjCIntentConsumer' failed

If we declare_directory/declare_file correctly for the symlink'd outputs then we still run into an issue where there's a conflict on what's seemingly an incremental build:
ERROR: /Users/matt.robinson/Developer/rules_ios/rules_ios/tests/ios/frameworks/intentdefinition/BUILD.bazel:3:16: Creating symlink bazel-out/applebin_ios-ios_sim_arm64-dbg-ST-8e9d4392bc2b/bin/tests/ios/frameworks/intentdefinition/ObjCIntentConsumer/ObjCIntentConsumer.framework/Headers/ObjCIntentConsumer_Intents.intentdefinition_gen.hdrs.h failed: failed to create symbolic link 'tests/ios/frameworks/intentdefinition/ObjCIntentConsumer/ObjCIntentConsumer.framework/Headers/ObjCIntentConsumer_Intents.intentdefinition_gen.hdrs.h' to 'tests/ios/frameworks/intentdefinition/ObjCIntentConsumer_Intents.intentdefinition_gen.hdrs.h' due to I/O error: /private/var/tmp/_bazel_matt.robinson/0e64031a9efbb95e4728094ee9457143/execroot/build_bazel_rules_ios/bazel-out/applebin_ios-ios_sim_arm64-dbg-ST-8e9d4392bc2b/bin/tests/ios/frameworks/intentdefinition/ObjCIntentConsumer/ObjCIntentConsumer.framework/Headers/ObjCIntentConsumer_Intents.intentdefinition_gen.hdrs.h (File exists)

It makes little sense to add .h “files” to Foo.framework/Headers that are actually directories so stop adding them to the resulting frameworks Headers directory unless they're files.

Re-requesting your review, @jerrymarino, since the change is now quite different from the initial implementation.


Update kernel to asahi-6.8.11-1

6.8.11 hasn't been pushed on Fedora yet. I did 6.8.10 here: https://github.com/tpwrules/nixos-apple-silicon/commit/b8d0d74c15e91a44d5e3010eb6b30e133a00b055


added initial TPO implementation

What does this PR do?
This PR adds initial TPO (Triple Preference Optimization) implementation.

Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[x] Did you read the contributor guideline,
Pull Request section?
[x] Was this discussed/approved via a GitHub issue? Please add a link
to it if that's the case. ( https://github.com/huggingface/trl/issues/1901 )
[x] Did you make sure to update the documentation with your changes? Here are the
documentation guidelines.
[x] Did you write any new necessary tests?

Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@qgallouedec

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Hi @qgallouedec,
I fixed the issues. I would appreciate it if you review the PR.

Thanks for contributing @sahsaeedi, sorry for the delay answering.
Do you have some reference results to share (wandb run) that use this implementation?

Hi @qgallouedec,
Yes, I fine-tuned llama3-8B-Instrcut on llama3-ultrafeedback-armorm dataset.

Let me know if you need some specific results.

so @sahsaeedi  I kinda refactored the DPO's data processing helpers etc. and was thinking... can one just subclass the DPOTrainer for this method?

Hi @kashif,
I am still trying to figure it out, and my main concern is processing the data. TPO data processing is a little different from DPO. Also, the dataset needs to be processed, and some conditions need to be met. It should be good to have inherent TPO from the Trainer instead of DPOTrainer. However, if you think we have to do that, I will start working on it.

Hi @qgallouedec,
Is there any update?

Hi @sahsaeedi, sorry for the delay. Could you please update your branch? We've been doing a lot of work recently to standardize the API through trainers, docs, configurations, etc. This branch should be aligned with recent changes. Feel free to ask if you need help with this.
In addition, we're working on refactoring the data processing in DPO (which I think your code is mainly inspired by) because it's too complex at the moment. I'd like to avoid refactoring two trainers, so I won't merge this one until it's done. You'll probably have to do a second round of update.


chore: update secrets baseline to prevent false positive

Signed-off-by: Dustin Popp<EMAIL_ADDRESS>

:tada: This PR is included in version 4.0.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


changing plain-git to https

It's much wiser and a lot more secure to use HTTPS protocol instead of plain-git.

git:// is a completely different protocol from ssh:// or remotes that contain an @.
See the list here