Lineraize depth buffer

It looks like sometimes the depth buffer is already linear (I think it's when the game creates depth in a DXGI_FORMATR32G8X24_TYPELESS buffer as opposed to a DXGI_FORMAT_R24G8_TYPELESS one). I tested on a geforce 1080 and titan X pascal and got this 64bit depth stencil buffer on both, however I got the 32 bit buffer on an intel iris pro system.
I have verified that the depth buffer is indeed linear in this case as transforming pixels into world space yields correct results.

Perhaps there's a way to get the game to always just use the linear buffer. That would be ideal.

FWIW I have a similar project at https://github.com/umautobots/GTAVisionExport (the native part) that gets correct depth and stencil on nvidia pascal platforms. Perhaps we can compare notes.

If the hardware supports it, I think this would be a great idea. For linear export from logarithmic one I used the game engine itself. It creates a smaller linear depth buffer for SSAO and I give it a full scale texture and re-render it.

Ahh. Unfortunately we need a full Rez depth buffer. I'm not sure if the linear depth is something gta does or something the nvidia drivers do

The depth buffer is rendered in full resolution. I don't think it's related to the drivers, since the game must have complete information about what data is inside the texture.

I guess I'll have to trace Tex creation. But the nvidia drivers do seem to
redirect a whole lot of functionality (we actually tried to detour via vtbl
editing and had to move to hotpatching and trampolines because the nvidia
drivers were already touching almost all the vtbl entries multiple times)
On Tue, May 9, 2017 at 1:32 PM ali-alidoust<EMAIL_ADDRESS>wrote:

The depth buffer is rendered in full resolution. I don't think it's
related to the drivers, since the game must have complete information about
what data is inside the texture.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ali-alidoust/gta5-extended-video-export/issues/11#issuecomment-300242370,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABPnvU95M7Cwat2huCSB-f_4k5KT9j6_ks5r4KMogaJpZM4NSaIp
.


Paperspace notebook starts only twice

Paperspace notebook starts only twice and these two times when I press the start machine button, it shows the loading animation and says that the GPU is out of capacity and I need to wait and I really waited and really could start the machine. But when I start machine for a third time, the button has no loading animation and paperspace says: Instance Free-GPU is not available please select another and throws back to the GPU window. When I open a new notebook it's exactly the same, it only starts twice and stops starting on the third time.
I asked about this paperspace support, but they didn't give me a clear answer, except that it's because of the high demand on free GPUs. I thought then maybe it's because of the notebook or sth. Do I have to reinstall the SD every time? What could this problem be?
https://github.com/TheLastBen/fast-stable-diffusion/assets/135654700/08ab9c10-223a-4262-8f69-5007931d4c83 (New notebook startup)
https://github.com/TheLastBen/fast-stable-diffusion/assets/135654700/9680bd0a-4a50-4f84-a8dc-f181507ad773 (Old notebook startup)

the free GPU isn't available all the time, if you have a monthly subscription, you can access the notebooks at anytime


After restore in container with new hostname - ioBroker not running/ admin not accessible

At the moment there seems to be an issue when restoring on a new Docker container with a different hostname.
After restart of the container the log says something like:
--------------------------------------------------------------------------------,
-----                    Step 5 of 5: ioBroker startup                     -----,
--------------------------------------------------------------------------------,
Starting ioBroker...,
================================== > LOG REDIRECT system.adapter.admin.0 => true [starting],
host.iobrokerold check instance "system.adapter.admin.0" for host "iobrokernew",
host.iobrokerold check instance "system.adapter.javascript.0" for host "iobrokernew",
host.iobrokerold check instance "system.adapter.backitup.0" for host "iobrokernew",
host.iobrokerold check instance "system.adapter.discovery.0" for host "iobrokernew",
host.iobrokerold check instance "system.adapter.dwd.0" for host "iobrokernew",
host.iobrokerold check instance "system.adapter.history.0" for host "iobrokernew"

This seems to be an issue in ioBroker restoring procedure. I already opened an issue in ioBroker js-controller repo:
https://github.com/ioBroker/ioBroker.js-controller/issues/1450
This issue is for documentation only. For workaround see next post.
Regards,
André

Known workaround:
To get ioBroker working after a restore, you have to call iobroker host [oldhostname] at the containers command line. Make sure you stopped ioBroker before. Here is an example:
root@iobrokernew:/opt/iobroker# pkill -u iobroker
root@iobrokernew:/opt/iobroker# iobroker host iobrokerold
Host "iobrokerold" successfully renamed to "iobrokernew".
No instances found for host "iobrokerold"!
root@iobrokernew:/opt/iobroker#

When using a singlehost you can use iobroker host this instead of iobroker host [oldhostname].
Don't use iobroker host this when using multhost (master/slave) system. For details see this link.
If you have any questions feel free to comment. Thank you.
Regards,
André

Short update:
An official  solution for this is confirmed for js-controller 4.0.x (for details see links above).
This issue remains open for documentation purpose until the fix will be available in a stable version.
Regards,
André

I tried the fix,
A host with the name "iobroker old" Allready exists.
Is the only answer I got....
I also tried to find a solution in the discord channel  (German iobroker - docker)

This seems still a problem in some way. Opened an issue at iobroker.js-controller.
https://github.com/ioBroker/ioBroker.js-controller/issues/2241

This should be fixed with js-controller v5. The issue will remain open until js-controller v5 release for documentation of the workaround.

My last test showed that this is no longer a problem.


Douglas/finished camera with master

Change thread for subscriptions.

I suggest that you next time push directly to this repo and not to your fork. That way @JonasVautherin and I can add commits as well. You should have the needed permissions.

To remove the executable fix from all swift files, just do:
find . -type f -perm +0111 -name "*.swift" | xargs chmod -x

Done. Let me know if it worked.

@JonasVautherin there are now conflicts, not sure what to do.


Fix markerEnd in BiDirectionalEdge component (was not passed down cor…

An initial attempt to fix the directional arrowhead issue. While the markerEnd is being passed down correctly now (to the custom Edge component), I'm still not happy how the arrow head aligns itself agains the edge line, particularly at very wide angles... Still happy to push this into main for now, as it's not a show stopper.


Can not require 'cudnn' when some of the GPUs are fully used

I'm using a machine with 6 GPUs. I found that, when I use " require 'cudnn' " in torch, it will occupy some memory in each GPU, several hundreds M. So, if some of the GPUs are fully used, there's not enough memory in them to initialize the cudnn. Following are the messages:
th> require 'cudnn'
Found Environment variable CUDNN_PATH = /home/liran/cudnn/lib64/libcudnn.so.5
THCudaCheck FAIL file=/home/liran/torch/extra/cutorch/init.c line=764 error=2 : out of memory
/home/liran/torch/install/share/lua/5.1/trepl/init.lua:389: /home/liran/torch/install/share/lua/5.1/trepl/init.lua:389: /home/liran/torch/install/share/lua/5.1/cudnn/ffi.lua:1624: cuda runtime error (2) : out of memory at /home/liran/torch/extra/cutorch/init.c:764
stack traceback:
[C]: in function 'error'
/home/liran/torch/install/share/lua/5.1/trepl/init.lua:389: in function 'require'
[string "_RESULT={require 'cudnn'}"]:1: in main chunk
[C]: in function 'xpcall'
/home/liran/torch/install/share/lua/5.1/trepl/init.lua:661: in function 'repl'
...iran/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:199: in main chunk
[C]: at 0x00406670
Actually I just want one GPU to work with. I'm wondering how can I select one or some GPUs to initialize the cudnn, rather than use all the GPUs ?

you should set CUDA_VISIBLE_DEVICES env var to just the GPU you want to run on.

@ngimel That works ! Thank you very much!


MPR does not sync slices when selecting slice-level qualitative annotations

Follow up on #2797.

To discuss: in OHIFv2 the MPR viewport ddo not support measurements/annotation. In fact when clicking on an item on the right panel, the first left (red) viewport  will be automatically be switched to a cornerstone viewport. Adding annotation to the MPR mode is a major rework. We could disable the measurement/annotation panel in MPR mode.

Yes, I think it is practical to just disable that panel then. It would be very nice to get it working, but I don't think major rework is a viable option for us, and would not be a good use of resources anyway given v3 on the horizon.

Yes, I think it is practical to just disable that panel then. It would be very nice to get it working, but I don't think major rework is a viable option for us, and would not be a good use of resources anyway given v3 on the horizon.

ok, there is a way to disable the panel in the config file at start up. I will see if it can be disabled at run time, so we can switch on/off when clicking the MPR mode.

There is no easy way to disable the measurement panel at run time, but I implemented a check wheen clicking on the annotation item and if the viewport is MPR mode, it will not propagate the selection and a warning will pop up.


drivers: counter: mcux_ctimer: config used as non-const

Describe the bug
These drivers seem to treat device configuration as non-const. For example:
https://github.com/zephyrproject-rtos/zephyr/blob/7dac931e3662eb666cdabc3bf1759a7484249730/drivers/counter/counter_mcux_ctimer.c#L186-L190
To Reproduce

Don't cast config to non-const (as it should be):

const struct mcux_lpc_ctimer_config *config = dev->config;

Build a board that uses the driver

Expected behavior
Device driver should use data to store non-ROMable data.
Impact
Impacts https://github.com/zephyrproject-rtos/zephyr/pull/41918
Logs and console output
N/A
Environment (please complete the following information):

OS: Linux
Toolchain Zephyr SDK 0.13.1
Commit SHA or Version used e8df8a579033be238beb774e4909d637da649f3a

Additional context
N/A

yep... that is a bug.

This seems like something static analysis should catch. Casting a const value into a non-const pointer..


Prepare Release <IP_ADDRESS>

Description
Release <IP_ADDRESS>
Questions/Ideas

Update CHANGELOG.md
Add missing deprecated features to docstrings

<IP_ADDRESS> to be released directly after 10.2.4 of Core.


Mentions are not case-insensitive

Fixed in https://github.com/bitwalker/exirc/pull/92.
If this doesn't get merged, or takes too long, then we'll just implement a fix in this library.

fix merged in dep


Python Skill Sample doesn't work

Sample information

Sample type: [\samples\python\80.skills-simple-bot-to-bot]
Sample language: [python]
Sample name: ,

Describe the bug
Running python simple-bot-to-bot Echo Skill on emulator, added ms app id and password for root bot and skill bot, got error from skill bot:
Tacktrace:
[on_turn_error] unhandled error: Cannot deserialize content-type: text/plain
Traceback (most recent call last):
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_adapter.py", line 128, in run_pipeline
    context, callback
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 69, in receive_activity_with_status
    return await self.receive_activity_internal(context, callback)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 79, in receive_activity_internal
    return await callback(context)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\activity_handler.py", line 68, in on_turn
    await self.on_message_activity(turn_context)
  File "d:\WorkingFolder\2020_10\BotBuilderSample\samples\python\80.skills-simple-bot-to-bot\echo-skill-bot\bots\echo_bot.py", line 21, in on_message_activity
    MessageFactory.text(f"Echo (python): {turn_context.activity.text}")
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 170, in send_activity
    result = await self.send_activities([activity_or_text])
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 217, in send_activities
    return await self._emit(self._on_send_activities, output, logic())
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 295, in _emit
    return await logic
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 212, in logic
    responses = await self.adapter.send_activities(self, output)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 728, in send_activities
    raise error
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 714, in send_activities
    activity.conversation.id, activity.reply_to_id, activity
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botframework\connector\aio\operations_async\_conversations_operations_async.py",
line 529, in reply_to_activity
    request, stream=False, **operation_config
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\async_client.py", line 115, in async_send
    pipeline_response = await self.config.pipeline.run(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 159, in run
    return await first_node.send(pipeline_request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 79, in send
    response = await self.next.send(request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_requests.py", line 106, in send
    return await self.next.send(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 84, in send
    self._policy.on_response(request, response, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 252, in on_response
    http_response.headers
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 226, in deserialize_from_http_generics
    return cls.deserialize_from_text(body_bytes, content_type)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 203, in deserialize_from_text
    raise DeserializationError("Cannot deserialize content-type: {}".format(content_type))
msrest.exceptions.DeserializationError: Cannot deserialize content-type: text/plain

 Exception caught on _send_error_message : Cannot deserialize content-type: text/plain
Traceback (most recent call last):
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_adapter.py", line 128, in run_pipeline
    context, callback
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 69, in receive_activity_with_status
    return await self.receive_activity_internal(context, callback)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 79, in receive_activity_internal
    return await callback(context)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\activity_handler.py", line 68, in on_turn
    await self.on_message_activity(turn_context)
  File "d:\WorkingFolder\2020_10\BotBuilderSample\samples\python\80.skills-simple-bot-to-bot\echo-skill-bot\bots\echo_bot.py", line 21, in on_message_activity
    MessageFactory.text(f"Echo (python): {turn_context.activity.text}")
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 170, in send_activity
    result = await self.send_activities([activity_or_text])
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 217, in send_activities
    return await self._emit(self._on_send_activities, output, logic())
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 295, in _emit
    return await logic
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 212, in logic
    responses = await self.adapter.send_activities(self, output)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 728, in send_activities
    raise error
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 714, in send_activities
    activity.conversation.id, activity.reply_to_id, activity
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botframework\connector\aio\operations_async\_conversations_operations_async.py",
line 529, in reply_to_activity
    request, stream=False, **operation_config
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\async_client.py", line 115, in async_send
    pipeline_response = await self.config.pipeline.run(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 159, in run
    return await first_node.send(pipeline_request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 79, in send
    response = await self.next.send(request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_requests.py", line 106, in send
    return await self.next.send(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 84, in send
    self._policy.on_response(request, response, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 252, in on_response
    http_response.headers
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 226, in deserialize_from_http_generics
    return cls.deserialize_from_text(body_bytes, content_type)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 203, in deserialize_from_text
    raise DeserializationError("Cannot deserialize content-type: {}".format(content_type))
msrest.exceptions.DeserializationError: Cannot deserialize content-type: text/plain

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "d:\WorkingFolder\2020_10\BotBuilderSample\samples\python\80.skills-simple-bot-to-bot\echo-skill-bot\adapter_with_error_handler.py", line 39, in _send_error_message
    await turn_context.send_activity(error_message)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 170, in send_activity
    result = await self.send_activities([activity_or_text])
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 217, in send_activities
    return await self._emit(self._on_send_activities, output, logic())
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 295, in _emit
    return await logic
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 212, in logic
    responses = await self.adapter.send_activities(self, output)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 728, in send_activities
    raise error
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 714, in send_activities
    activity.conversation.id, activity.reply_to_id, activity
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botframework\connector\aio\operations_async\_conversations_operations_async.py",
line 529, in reply_to_activity
    request, stream=False, **operation_config
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\async_client.py", line 115, in async_send
    pipeline_response = await self.config.pipeline.run(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 159, in run
    return await first_node.send(pipeline_request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 79, in send
    response = await self.next.send(request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_requests.py", line 106, in send
    return await self.next.send(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 84, in send
    self._policy.on_response(request, response, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 252, in on_response
    http_response.headers
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 226, in deserialize_from_http_generics
    return cls.deserialize_from_text(body_bytes, content_type)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 203, in deserialize_from_text
    raise DeserializationError("Cannot deserialize content-type: {}".format(content_type))
msrest.exceptions.DeserializationError: Cannot deserialize content-type: text/plain

 Exception caught on _send_eoc_to_parent : Cannot deserialize content-type: text/plain
Traceback (most recent call last):
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_adapter.py", line 128, in run_pipeline
    context, callback
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 69, in receive_activity_with_status
    return await self.receive_activity_internal(context, callback)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\middleware_set.py", line 79, in receive_activity_internal
    return await callback(context)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\activity_handler.py", line 68, in on_turn
    await self.on_message_activity(turn_context)
  File "d:\WorkingFolder\2020_10\BotBuilderSample\samples\python\80.skills-simple-bot-to-bot\echo-skill-bot\bots\echo_bot.py", line 21, in on_message_activity
    MessageFactory.text(f"Echo (python): {turn_context.activity.text}")
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 170, in send_activity
    result = await self.send_activities([activity_or_text])
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 217, in send_activities
    return await self._emit(self._on_send_activities, output, logic())
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 295, in _emit
    return await logic
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 212, in logic
    responses = await self.adapter.send_activities(self, output)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 728, in send_activities
    raise error
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 714, in send_activities
    activity.conversation.id, activity.reply_to_id, activity
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botframework\connector\aio\operations_async\_conversations_operations_async.py",
line 529, in reply_to_activity
    request, stream=False, **operation_config
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\async_client.py", line 115, in async_send
    pipeline_response = await self.config.pipeline.run(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 159, in run
    return await first_node.send(pipeline_request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 79, in send
    response = await self.next.send(request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_requests.py", line 106, in send
    return await self.next.send(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 84, in send
    self._policy.on_response(request, response, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 252, in on_response
    http_response.headers
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 226, in deserialize_from_http_generics
    return cls.deserialize_from_text(body_bytes, content_type)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 203, in deserialize_from_text
    raise DeserializationError("Cannot deserialize content-type: {}".format(content_type))
msrest.exceptions.DeserializationError: Cannot deserialize content-type: text/plain

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "d:\WorkingFolder\2020_10\BotBuilderSample\samples\python\80.skills-simple-bot-to-bot\echo-skill-bot\adapter_with_error_handler.py", line 71, in _send_eoc_to_parent
    await turn_context.send_activity(end_of_conversation)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 170, in send_activity
    result = await self.send_activities([activity_or_text])
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 217, in send_activities
    return await self._emit(self._on_send_activities, output, logic())
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 295, in _emit
    return await logic
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\turn_context.py", line 212, in logic
    responses = await self.adapter.send_activities(self, output)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 728, in send_activities
    raise error
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botbuilder\core\bot_framework_adapter.py", line 714, in send_activities
    activity.conversation.id, activity.reply_to_id, activity
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\botframework\connector\aio\operations_async\_conversations_operations_async.py",
line 529, in reply_to_activity
    request, stream=False, **operation_config
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\async_client.py", line 115, in async_send
    pipeline_response = await self.config.pipeline.run(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 159, in run
    return await first_node.send(pipeline_request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 79, in send
    response = await self.next.send(request, **kwargs)  # type: ignore
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_requests.py", line 106, in send
    return await self.next.send(request, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\async_abc.py", line 84, in send
    self._policy.on_response(request, response, **kwargs)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 252, in on_response
    http_response.headers
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 226, in deserialize_from_http_generics
    return cls.deserialize_from_text(body_bytes, content_type)
  File "C:\Users\username\AppData\Roaming\Python\Python37\site-packages\msrest\pipeline\universal.py", line 203, in deserialize_from_text
    raise DeserializationError("Cannot deserialize content-type: {}".format(content_type))
msrest.exceptions.DeserializationError: Cannot deserialize content-type: text/plain

Can someone tell me what is wrong?
Thanks in advance.

Summary: I have tested \samples\python\80.skills-simple-bot-to-bot in Python and its working fine.

Steps Taken:

Updated echo-skill-bot/config.py with the MicrosoftAppId and MicrosoftAppPassword of the new bot registration.
Updated simple-root-bot/config.py with the MicrosoftAppId and MicrosoftAppPassword of the new bot registration.
Updated the SKILLS.app_id in simple-root-bot/config.py with the MicrosoftAppId.
Add the simple-root-bot MicrosoftAppId to the AllowedCallers comma separated list in echo-skill-bot/config.py.
Run Both sample echo-skill-bot and simple-root-bot in separate terminal on VS Code.
Test it on emulator by providing MicrosoftAppId and MicrosoftAppPassword.


relationship one to one is missing

If I create relationship one to one for primary key in ms access then it is not converted to sqlite db.
I have two tables t_device and t_device_data_last.
There are primary keys:
t_device.id
t_device_data_last.deviceId
and it has relationship one-to-one.
detail from ms access:
Relationships
t_devicet_device_data_last
t_device                       t_device_data_last
id                         1     1  deviceId
              Attributes:                Unique; Enforced; Cascade Updates; Cascade Deletes
              RelationshipType:          One-To-One

detail from sqllite (dump.txt)
CREATE TABLE t_device_data_last (deviceId REAL NOT NULL PRIMARY KEY UNIQUE,dateTime TEXT COLLATE NOCASE,temperature REAL,humidity REAL DEFAULT 0,batteryPower REAL DEFAULT 0,dateTimeInt REAL,runCnt INTEGER,restarfromZeroCnt INTEGER,lastRunCnt INTEGER,runningTime INTEGER,pressure REAL DEFAULT 0,co2 INTEGER DEFAULT 0,tvoc INTEGER DEFAULT 0,baseLineReg INTEGER DEFAULT 0,current INTEGER DEFAULT 0 /*current in micro ampere */,voltage INTEGER DEFAULT 0 /*voltage */);
there is missing FOREIGN KEY(deviceId) REFERENCES t_device(id) in dump.txt for CREATE TABLE of t_device_data_last table.
The table t_device_data_last is created before t_device.
How is check which table should be created first? Is it important during conversion?

Could you provide the database you are trying to convert?
Yes it is important referenced table should already be created.

And afcourse Foreign key are only supported if you check the checkbox in the settings dialog

By the way you probably have the last setting checked: "Foreign key Both primary fields"
If this setting is checked and there is a relationship primary key - primary key. It is not created, so you should uncheck it since it is checked by default.

Yes, I have the last setting checked: "Foreign key Both primary fields". But if I unchecked it there is assert in method
int CRelationships::Findind ( CString *&sTableNames , CString &sSearchedTable , const unsigned &nTreeSize )
{
for ( unsigned i3 = 0; i3 < nTreeSize; ++i3 )
{
if ( !( sTableNames [ i3 ].Compare ( sSearchedTable ) ) )
return i3;
}
ASSERT ( FALSE );
return -1;
}

Test.mdb
Test.zip

Fixed, MS was adding additional system tables which were not checked during relationship creation.


replacing awk with cut.

awk does not seem to work. Please confirm.
We missed to include this in the previous pull request.
Thanks.

CLA is valid!

Hello @anfeng ,
I came across an error while installing CoS on a fresh ubuntu instance installed with Hadoop 2.7.1 and Spark 2.0.0. Spark version is still not being fetched since SPARK_HOME is not set properly. Please see this:
ifeq ($(shell which spark-submit), "")
     SPARK_HOME ?=/home/y/share/spark
     $(info $$SPARK_HOME_DEFAULT is [${SPARK_HOME}])
else
     SPARK_HOME ?=$(shell which spark-submit 2>&1 | sed 's/\/bin\/spark-submit//g')
     $(info $$SPARK_HOME_LOCAL is [${SPARK_HOME}])
endif
$(info $$HOME is [${HOME}])

Log:
cc@arun-master:~/CaffeOnSpark$ sudo make clean
$SPARK_HOME_LOCAL is []
$HOME is [/home/cc]
cd caffe-public; make clean; cd ..
make[1]: Entering directory `/home/cc/CaffeOnSpark/caffe-public'
make[1]: Leaving directory `/home/cc/CaffeOnSpark/caffe-public'
cd caffe-distri; make clean; cd ..
make[1]: Entering directory `/home/cc/CaffeOnSpark/caffe-distri'
mvn clean

You need to either set spark_home or have its bin included in path.
Andy Feng
Sent from my iPhone

On Oct 16, 2016, at 12:53 PM, Arun Das<EMAIL_ADDRESS>wrote:
Hello @anfeng ,
I came across an error while installing CoS on a fresh ubuntu instance installed with Hadoop 2.7.1 and Spark 2.0.0. Spark version is still not being fetched since SPARK_HOME is not set properly. Please see this:
ifeq ($(shell which spark-submit), "")
SPARK_HOME ?=/home/y/share/spark
$(info $$SPARK_HOME_DEFAULT is [${SPARK_HOME}])
else
SPARK_HOME ?=$(shell which spark-submit 2>&1 | sed 's//bin/spark-submit//g')
$(info $$SPARK_HOME_LOCAL is [${SPARK_HOME}])
endif
$(info $$HOME is [${HOME}])
Log:
cc@arun-master:~/CaffeOnSpark$ sudo make clean
$SPARK_HOME_LOCAL is []
$HOME is [/home/cc]
cd caffe-public; make clean; cd ..
make[1]: Entering directory /home/cc/CaffeOnSpark/caffe-public' make[1]: Leaving directory /home/cc/CaffeOnSpark/caffe-public'
cd caffe-distri; make clean; cd ..
make[1]: Entering directory `/home/cc/CaffeOnSpark/caffe-distri'
mvn clean
―
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I have both set-up.
Please see my .bashrc
export SPARK_HOME=/usr/local/spark
export PATH=$PATH:$SPARK_HOME/bin

I can do which spark-submit in my logged in session.
cc@arun-master:~$ which spark-submit
/usr/local/spark/bin/spark-submit

Maybe you don't have sed available?
Andy Feng
Sent from my iPhone

On Oct 16, 2016, at 12:53 PM, Arun Das<EMAIL_ADDRESS>wrote:
Hello @anfeng ,
I came across an error while installing CoS on a fresh ubuntu instance installed with Hadoop 2.7.1 and Spark 2.0.0. Spark version is still not being fetched since SPARK_HOME is not set properly. Please see this:
ifeq ($(shell which spark-submit), "")
SPARK_HOME ?=/home/y/share/spark
$(info $$SPARK_HOME_DEFAULT is [${SPARK_HOME}])
else
SPARK_HOME ?=$(shell which spark-submit 2>&1 | sed 's//bin/spark-submit//g')
$(info $$SPARK_HOME_LOCAL is [${SPARK_HOME}])
endif
$(info $$HOME is [${HOME}])
Log:
cc@arun-master:~/CaffeOnSpark$ sudo make clean
$SPARK_HOME_LOCAL is []
$HOME is [/home/cc]
cd caffe-public; make clean; cd ..
make[1]: Entering directory /home/cc/CaffeOnSpark/caffe-public' make[1]: Leaving directory /home/cc/CaffeOnSpark/caffe-public'
cd caffe-distri; make clean; cd ..
make[1]: Entering directory `/home/cc/CaffeOnSpark/caffe-distri'
mvn clean
―
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Checked that. I will try again in another system.
cc@arun-master:~$ sed
Usage: sed [OPTION]... {script-only-if-no-other-script} [input-file]...

  -n, --quiet, --silent
                 suppress automatic printing of pattern space
  -e script, --expression=script
                 add the script to the commands to be executed
..........
..........

Will it make a difference if you replace '?=' by '='?

I tried it with =, :=. Both did not work.

You may want to check your make manual. Your new system may use a different Make tool. Try "make --version"

Make version is the same as my old machine.
cc@arun-master:~$ make --version
GNU Make 3.81
Copyright (C) 2006  Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.

This program built for x86_64-pc-linux-gnu

Maybe you should echo the ${SPARK_HOME} and $(shell which spark-submit) before the conditional assignment? On your shell, you could try

which spark-submit 2>&1 | sed 's//bin/spark-submit//g'

Yes. I tried each commands in shell separately and all of them (except awk) did work.
cc@arun-master:~$ which spark-submit 2>&1 | sed 's/\/bin\/spark-submit//g'
/usr/local/spark
cc@arun-master:~$ ${SPARK_HOME}/bin/spark-submit --version 2>&1 | grep version | cut -d' ' -f10 | cut -d'.' -f1
2
cc@arun-master:~$ ${SPARK_HOME}/bin/spark-submit --version 2>&1 | grep version | awk '{print $$5}' | cut -d'.' -f1

cc@arun-master:~$

I just confirmed this with another Ubuntu 14.04 instance. Spark version variable is not set in Makefile, awk does not work in line 13.
I will try an Ubuntu 16 instance later today.

Update:
In a fresh Ubuntu 16 instance with sed, awk, without setting SPARK_HOME or its bin as environment variables or in .bashrc, I tried sudo make clean after adding these lines:
ifeq ($(shell which spark-submit), "")
     SPARK_HOME ?=/home/y/share/spark
     $(info $$SPARK_HOME_DEFAULT is [${SPARK_HOME}])
else
     SPARK_HOME ?=$(shell which spark-submit 2>&1 | sed 's/\/bin\/spark-submit//g')
     $(info $$SPARK_HOME_LOCAL is [${SPARK_HOME}])
endif

According to your logic, if spark-submit does not work, then SPARK_HOME must be set as SPARK_HOME =/home/y/share/spark.
However, the logic ifeq ($(shell which spark-submit), "") fails and I get this as the output when I do make clean:
$SPARK_HOME_LOCAL is []

I looked into this issue and found that changing the condition to the below mentioned logic does work:
ifeq ($(shell which spark-submit),)

I think the if condition did not take "" as NULL character. I added a test flag in Makefile (which did nothing) for simplicity. With this change, I get:
cc@arun-master:~/CaffeOnSpark$ make test
$SPARK_HOME_DEFAULT is [/home/y/share/spark]
make: 'test' is up to date.

Please change:
ifeq ($(shell which spark-submit),"")
to
ifeq ($(shell which spark-submit),)

changes in if condition corrects awk part in line 13.
Successfully used mvn -Dspark2 clean
Shall I take my changes to line 13 off ?

Yeah, let's minimize our changes.

Reverted back to awk. This was a bit tricky to debug :)
Thanks for the help and directions. I'm learning a lot these days.

+1


disable catalog pipeline

Description
The catalog pipeline is triggering but failing with:
Pulling the .catalog-onboard-pipeline.yaml file from the repos primary branch..
Did not find required file .catalog-onboard-pipeline.yaml. Please ensure this file exists, or specify a different git branch/tag using the --pipeline_yaml_branch arg. Exiting.
Catalog onboarding failed. Creating a GitHub issue..

Disabling the pipeline for this experimental repo
Release required?

[ ] No release
[ ] Patch release (x.x.X)
[ ] Minor release (x.X.x)
[ ] Major release (X.x.x)

Release notes content

Run the pipeline
If the CI pipeline doesn't run when you create the PR, the PR requires a user with GitHub collaborators access to run the pipeline.
Run the CI pipeline when the PR is ready for review and you expect tests to pass. Add a comment to the PR with the following text:
/run pipeline

Checklist for reviewers

[ ] If relevant, a test for the change is included or updated with this PR.
[ ] If relevant, documentation for the change is included or updated with this PR.

For mergers

Use a conventional commit message to set the release level. Follow the guidelines.
Include information that users need to know about the PR in the commit message. The commit message becomes part of the GitHub release notes.
Use the Squash and merge option.

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


convert array to object

Hello all,
How i can overcome the problem of assigning firstname from array instead of static value.
I don't want this -
smartTableData = [
{
id: 1,
firstname:  'asdf',
def: 'asdf',,
asdf: '124',
age: '28'
},
{
id: 2,
firstname:  'asddadsfaf',
def: 'asasdfadf',,
asdf: '12234',
age: '28'
}
]
I want to use like this, where
smartTableData = [
{
id: 1,
firstname:  this.firstname,
def: 'asdf',,
asdf: '124',
age: '28'
}	]
Where firstname contains thousands of username.
like
for(var i = 0; i < this.firstname.length; i++){
console.log(this.firstname);
}

I am sorry, but I do not understand what you're trying to achieve and what your problem is. The loop you mentioned logs out the firstname property as many times as there are characters in that word. Your excerpts also do not make much sense to me, unfortunately.
Could you please describe more carefully what's the expected result?

Hello @Gelio,
I just want to assign dynamic value to object instead of static value.
Not this -
smartTableData = [
{
id: 1,
firstname: 'asdf',
def: 'asdf',,
asdf: '124',
age: '28'
}]
Like this-
smartTableData = [
{
id: 1,
firstname: asdf,
def: asdf,
asdf: myAllNumbers,
age: myAge
}]
where asdf,myAllNumbers all contains 100 of records

Thanks @Gelio,
I Got the solution. i am closing this issue.!


Using --files-from and a file with a BOM causes 1. entry to be skipped

Output of restic version
restic 0.7.3
compiled with go1.9 on windows/amd64
How did you run restic exactly?
D:\restic>restic_0.7.3_windows_amd64.exe -r test backup --files-from files.txt
D:\restic?abc.txt does not exist, skipping
enter password for repository:
using parent snapshot 5d4da7df
scan [D:\restic\def.txt D:\restic\xyz]
scanned 1 directories, 1 files in 0:00
[0:00]   0B/s  0B / 0B  2 / 2 items  0 errors  ETA 0:00
duration: 0:00, 0.00MiB/s
snapshot 0ca43992 saved
D:\restic>dir
Volume in drive D is Data
Volume Serial Number is 5AE5-3725
Directory listing of D:\restic
19-11-2017  21:25                 0 abc.txt
19-11-2017  21:25                 0 def.txt
19-11-2017  21:30                26 files.txt
20-09-2017  18:53        10.423.808 restic_0.7.3_windows_amd64.exe
17-11-2017  20:19    DIR          test
19-11-2017  21:27    DIR          xyz
files.txt is a simple UTF-8 encoded textfile with BOM containing:
abc.txt
def.txt
xyz
Saving the file as UTF-8 without BOM makes everything work, but as this makes it harder to edit the file and be sure its saved as UTF-8 (and not just ANSI or whatever notepad or another texteditor on Windows does by default) a BOM is normally used to make sure an editor recognizes the proper file encoding..
What backend/server/service did you use?
None - local repository
Expected behavior
All listed files/paths in the --files-from file is processed regardless of a the presence or absence of a BOM
Actual behavior
The first line of the file is either detected as a nonexisting directory or file
Steps to reproduce the behavior
Please see above
Do you have any idea what may have caused this?
No support for BOM in files?
Perhaps its also an issue for --password-file ? (not tested!)
Do you have an idea how to solve the issue?
Make restic BOM-aware everywhere it reads files.

Thanks for the report. What's a BOM? I guess it's the UTF-8 Byte Order Mark? Can you attache a sample file with such a mark so I can have a look?
I can confirm that there's no code in restic which detects or interprets a byte order mark in the first line of the file, it'll be treated just like every other line (i.e. as a filename).
For --password-file, the contents is treated as-is, without any interpretation. So if a byte order mark is in there, it's passed to the key derivation function directly.

Yes, it's a Byte Order Mark (its different from encoding to encoding).
Attached is the files.txt I used for testing with an UTF-8 BOM as created by some random texteditor.
files.txt
Any BOM should be stripped by whatever it opening the file before reading the contents is passed onwards. BOMs are at least 4 bytes long (and goes up towards 10 bytes - https://en.wikipedia.org/wiki/Byte_order_mark), but you'll probably never meet any other than UTF-8, UTF-16 and -32 (in both BE and LE versions) on the OSes that restic runs on.
Regarding the --password-file (and indeed all other files read by restic) and passing the BOM to the key encryption logic I'd hazard a guess and say that its wrong to do so.
I see 2 scenarios where passing the BOM on could cause problems:

Not beeing able to use --password-file to specify a password to an already initialized repository (since the file has 4 or 6 bytes extra data, which causes the password to be wrong) or
Iif a repository is initialized with a password read via --password-file, then attempting to access the repository by manual key entry gives an error. Given that the password-file might have been lost, this would be quite a showstopper in a recovery scenario where an unbeknownst addition of a BOM causes a paper-backup of the key to be useless..

Otherwise a small entry in the manual saying that all files must be in UTF-8 with or without a BOM and that any other BOM is void should lower the amount of needed changes.. :)


Support Sdk="MSBuild.Sdk.SqlProj/1.10.0" in .sqlproj Project setting for standalone build

Is your feature request related to a problem? Please describe.
When doing a cross platform build if the build machine doesn't have access to the '.targets' file then the build will fail
Describe the solution or feature you'd like
The MSBuild Sdk for SQLProj, https://github.com/rr-wfm/MSBuild.Sdk.SqlProj , provides an option for the build to work
There are limitations on referenced database (need nuget or import via relevant file path) and Pre/Post deployment scripts need to be single file (':r' import not currently supported)
Describe alternatives you've considered
The alternative is to add dependencies to build server, this requires cloning folder
C:\Users\ {user} \ .azuredatastudio\extensions\microsoft.sql-database-projects-0.6.1\BuildDirectory
from a machine with ADS extension added, this requires a check and update for updates of the extension / patches to the system database dacpacs
Additional context
This links to issues with cross platform build and details added to https://github.com/microsoft/azuredatastudio/issues/14075

@malcolm738 an alpha package has been released if you'd like to try it: https://www.nuget.org/packages/Microsoft.Build.Sql/0.1.1-alpha
instructions can be found here: https://github.com/microsoft/DacFx/tree/main/src/Microsoft.Build.Sql

Microsoft.Build.Sql is now public preview! More info: https://techcommunity.microsoft.com/t5/azure-sql-blog/microsoft-build-sql-the-next-frontier-of-sql-projects/ba-p/3290628


some layers are not loaded

Why do i recieve this msg when running "python web_demo.py"?
""Some weights of LlamaForCausalLM were not initialized from the model checkpoint at FreedomIntelligence/AceGPT-7B-chat and are newly initialized: ['model.layers.21.self_attn.rotary_emb.inv_freq', 'model.layers.8.self_attn.rotary_emb.inv_freq', 'model.layers.18.self_attn.rotary_emb.inv_freq', 'model.layers.29.self_attn.rotary_emb.inv_freq', 'model.layers.1.self_attn.rotary_emb.inv_freq', 'model.layers.10.self_attn.rotary_emb.inv_freq', 'model.layers.15.self_attn.rotary_emb.inv_freq', 'model.layers.14.self_attn.rotary_emb.inv_freq', 'model.layers.11.self_attn.rotary_emb.inv_freq', 'model.layers.3.self_attn.rotary_emb.inv_freq', 'model.layers.17.self_attn.rotary_emb.inv_freq', 'model.layers.6.self_attn.rotary_emb.inv_freq', 'model.layers.7.self_attn.rotary_emb.inv_freq', 'model.layers.19.self_attn.rotary_emb.inv_freq', 'model.layers.20.self_attn.rotary_emb.inv_freq', 'model.layers.28.self_attn.rotary_emb.inv_freq', 'model.layers.31.self_attn.rotary_emb.inv_freq', 'model.layers.16.self_attn.rotary_emb.inv_freq', 'model.layers.25.self_attn.rotary_emb.inv_freq', 'model.layers.0.self_attn.rotary_emb.inv_freq', 'model.layers.2.self_attn.rotary_emb.inv_freq', 'model.layers.4.self_attn.rotary_emb.inv_freq', 'model.layers.9.self_attn.rotary_emb.inv_freq', 'model.layers.22.self_attn.rotary_emb.inv_freq', 'model.layers.27.self_attn.rotary_emb.inv_freq', 'model.layers.30.self_attn.rotary_emb.inv_freq', 'model.layers.26.self_attn.rotary_emb.inv_freq', 'model.layers.5.self_attn.rotary_emb.inv_freq', 'model.layers.13.self_attn.rotary_emb.inv_freq', 'model.layers.23.self_attn.rotary_emb.inv_freq', 'model.layers.24.self_attn.rotary_emb.inv_freq', 'model.layers.12.self_attn.rotary_emb.inv_freq']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

Hi， we have recently updated our model on Hugging Face. This update addresses the problem you're experiencing. To resolve the issue, please download the latest version of the model from Hugging Face and test it again.

@Mahmoud-SaadEl-Din  "self_attn.rotary_emb.inv_freq" is not trainable weights and I guess re-initialize will not inluence it's value(https://github.com/LianjiaTech/BELLE/issues/349#issuecomment-1544942632).
And this warning is caused by transformers version.


[Bug]: Division by zero error

Bug report requirements

[X] I have confirmed that this is a bug and not a configuration/user error.
[X] I have searched for existing issues and confirmed that my issue has not been reported before.

IconCaptcha version
4.0.3
PHP version
8.1
Browsers affected
Google Chrome, Mozilla Firefox, Safari
Expectation
when i go to https://staging-avoventes.cnbnet.fr/ and the click on the "Inscription" button, a modal appears with the iconCaptcha. clicking on the "Verifiez que vous etes humain" show the icons properly, but when you clock on an icon, an error occurs...
Actual behaviour
The captcha is loading properly but when i select the image, i have that error :
Division by zero {"exception":"[object] (DivisionByZeroError(code: 0): Division by zero at /var/www/cnb-avoventes/vendor/fabianwennink/iconcaptcha/src/Challenge/Challenge.php:365)
The error is there :
private function determineClickedIcon(int $clickedXPos, int $clickedYPos, int $captchaWidth, int $iconAmount): int
{
// Check if the clicked position is valid.
if ($clickedXPos < 0 || $clickedXPos > $captchaWidth || $clickedYPos < 0 || $clickedYPos > self::MAX_HEIGHT_OF_CHALLENGE) {
return -1;
}
return (int)ceil($clickedXPos / ($captchaWidth / $iconAmount));   // <--- line 365
}
Relevant log information
I put the same code im my dev server and everything works well (see epimmo.mwa.fr)

Additional information
The error occurs on my PreProd server, these are the appache directive differences :
--- Serveu on wich the iConCaptcha Works : --------------
add_header Strict-Transport-Security “max-age=31536000; includeSubDomains” always;
add_header X-XSS-Protection “1; mode=block”;
add_header X-Frame-Options deny always;
add_header Permissions-Policy “fullscreen=self, geolocation=*“;
add_header Referrer-Policy no-referrer-when-downgrade;
add_header X-Content-Type-Options nosniff;
----- Server on wich it does'nt work : ---------
add_header Content-Security-Policy “script-src ‘self’ ‘unsafe-inline’ ‘unsafe-eval’ *.cookiebot.com *.sharethis.com maps.googleapis.com www.google.com www.google.fr www.gstatic.com https://stats.avocat.fr/ https://embed.tawk.to/ https://cdn.jsdelivr.net/ *.jquery.com *.cloudflare.com *.bootstrapcdn.com; frame-src ‘self’ cotisation.cnb.avocat.fr cotisation-staging.adcot.cnbnet.fr staging-cotisation.cnbnet.fr consentcdn.cookiebot.com www.google.com https://ws.sharethis.com/; style-src ‘self’ ‘unsafe-inline’ fonts.gstatic.com fonts.googleapis.com https://ws.sharethis.com/ *.bootstrapcdn.com https://embed.tawk.to/; frame-ancestors ‘none’“;

Hi, what I think is the problem is that the session can't be loaded on your production server. The payload values which are sent to the server in the request are correct, there is nothing strange there. All payload values contain expected values.
The zero value in this case is most likely $iconAmount, which is loaded from the session on line 232 of the same file. This might be due to your server settings or your security policies which are set incorrectly or set too strict. Especially since it does work on your development server.

Closed due to inactivity


Upgrade to latest dependencies

Produced via:
./hack/update-deps.sh --upgrade
./hack/update-codegen.sh
Proposed Changes

Release Note

Docs

/cc @lionelvillard

/lgtm
/approve


Rendering of markdown code blocks doesn't work as expected

The Issue
Steps to reproduce

Open the app (version 0.12.3)
Go to: lbry://@morngrar#9/codeblocks-test#1
See what works, and what doesn't

Expected behaviour
I'd expect all of the examples in the given publish to work somewhat like on the desktop app: resulting in a stylized box around the content, and preserving line endings within.
Actual behaviour
All of the code blocks' content is printed on a single line, and there is no stylized box
System Configuration

Device: Sony Xperia H8324
Android version: 10

Screenshots

Internal Use
Acceptance Criteria

Definition of Done

[ ]  Tested against acceptance criteria
[ ] Tested against the assumptions of the user story
[ ] The project builds without errors
[ ] Unit tests are written and passing
[ ] Tests on devices/browsers listed in the issue have passed
[ ] QA performed & issues resolved
[ ] Refactoring completed
[ ] Any configuration or build changes documented
[ ] Documentation updated
[ ] Peer Code Review performed

This works as expected with appropriate newlines in the native app rewrite. It doesn't display a stylized box container, however.

What are "appropriate newlines"? 🤔 Do you mean '\r\n'? If that's the case, I wouldn't call the issue solved.

I meant new lines in terms of how it's displayed in the web view.

So typographic then. Is the update live on google play now, or hasn't it been pushed yet?

It's live on the beta track. You'd need to enroll as a participant in the beta to be able to get that version.


Deleting or working on the FPLO parser.

@ladinesa @ndaelman-hu I just checked the FPLO parser.
Is anybody outside our team developing this parser? If not, I see two options:

We work properly on it and parse the metadata.
We delete it. This is my preferred option, but I would like to hear from you (maybe someone is developing it in an OASIS).

It is a basic parser, essentially waiting for development. I suggest you do not delete it but rather work on it if you like. You can try to adapt an existing parser if you prefer it but we should develop it independently. This is the essence of parser plug ins.

If it is waiting for development, shouldn't be moved to another project? I thought atomistic, electronic, etc., are parsers that are more or less under control.
For me, it is questionable to say that we support FPLO.
What do you think @ndaelman-hu ?

We have over 2.5k entries that are identified as FPLO Geometry Optimization, so we should serve these entries too.
Still, it isn't entirely clear how these are labelled as such, given how bare-bones the FPLO parser is. @ladinesa Do you know?

I wrote BasicParser a few years back to parse basic calculation and system info for cover the parsers that have zero entries in nomad hence very little incentive to write a full parser. Now that you have pointed out these entries, I will put it in my TODO list to build a full parser.

Okay, thx! I am subscribed to the FPLO newsletter, if you need additional intel.

Great, thanks @ladinesa 👍🏻

By the way, there was a recent issue in the FORUM related with FPLO: https://matsci.org/t/changing-reference-for-all-publications-in-a-dataset/50381/9
If you need help, I can lend you a hand for the Wannier parsing in FPLO, but for this I would need some example files. Let me know if you want me to take care of it in a future.

The data is in NOMAD now: https://nomad-lab.eu/prod/v1/staging/gui/upload/id/GoRl3HTXTVG8mUrVpGmSog


update regex in AccessLogger to accept underscore

What do these changes do?

Update regex in AccessLogger to accept underscore, update Unit Tests
Are there changes in behavior for the user?
no

Related issue number
#1225

Checklist

[x] I think the code is well written
[x] Unit tests for the changes exist
[x] Documentation reflects the changes
[x] Add yourself to CONTRIBUTORS.txt
[x] Add a new entry to CHANGES.rst

Choose any open position to avoid merge conflicts with other PRs.
Add a link to the issue you are fixing (if any) using #isuue_number format at the end of changelog message. Use Pull Request number if there are no issues for PR or PR covers the issue only partially.

update Unit Tests

Current coverage is 98.28% (diff: 100%)

Merging #1226 into master will not change coverage

@@             master      #1226   diff @@
==========================================
  Files            29         29
  Lines          6485       6485
  Methods           0          0
  Messages          0          0
  Branches       1087       1087
==========================================
  Hits           6374       6374
  Misses           59         59
  Partials         52         52

Powered by Codecov. Last update 54808c7...1fa3fc0

I am already in CONTRIBUTORS.txt from a previous contribution :)

Thanks!


Crash on launch of the Clarius Cast Android example app

Hello,
I'm trying to run the latest example app with the latest .aar from this repository on my Android device but I'm experiencing a crash on launch. It can't seem to find the Qt library, this is the error:
java.lang.UnsatisfiedLinkError: dlopen failed: library "libQt6Core_x86_64.so" not found at java.lang.Runtime.loadLibrary0(Runtime.java:1077) at java.lang.Runtime.loadLibrary0(Runtime.java:998) at java.lang.System.loadLibrary(System.java:1656) at me.clarius.sdk.Cast.<init>(Cast.java:27) at me.clarius.sdk.cast.example.CastService.onCreate(CastService.java:91) ...
Looking at the line it crashes it seems it's looking for a wrong filename, at least the prefix seems wrong:
System.loadLibrary(abiLib("Qt6Core"));
While looking into the .aar package, it contains this dependency: libQt6Core_armeabi-v7a.so
Any thoughts on what I'm doing wrong perhaps?
Thank you!

Hello I just uploaded the .aar files for x86 and x86_64: https://github.com/clariusdev/cast/releases/tag/v10.1.1, select the cast-10.1.1-android.x86_64.aar package if you need x86_64.

The new .aar files work! The issue can be closed, thanks!


Troubleshoot user errors with Office Add-ins

suggestions
add the location of the debug log for internet explorer.
Can you add anything for when users get 'Access denied'?
Otherwise great article.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b6cb5f52-dfc5-4fa2-6508-194d6f1c674a
Version Independent ID: 8f3caf2d-fba3-166f-43bc-1d3e4007abab
Content: Troubleshoot user errors with Office Add-ins - Office Add-ins
Content Source: docs/testing/testing-and-troubleshooting.md
Product: non-product-specific
Technology: add-ins
GitHub Login: @o365devx
Microsoft Alias: o365devx

Hi @HeatherAllemang - Thanks for reading our docs and for the suggestions! We will go ahead and take them into consideration and add appropriate work items to our backlog. Are you having an "access denied" error that you need assistance with? If so, to help troubleshoot it would be great if you can give me some more details about the situation in which you get this message (what action are you trying to perform, what product are you using, etc). Thanks!

Hello,
I have the fix for this now.  The users need to have the ‘Read/Write’ mailbox permissions role, which is talked about here:
https://docs.microsoft.com/en-us/exchange/clients-and-mobile-in-exchange-online/add-ins-for-outlook/specify-who-can-install-and-manage-add-ins
We get a fair amount of tickets where users cannot use add-ins.
thanks
Heather
From: Michelle Scharlock<EMAIL_ADDRESS>Sent: Monday, June 10, 2019 12:08 PM
To: OfficeDev/office-js-docs-pr<EMAIL_ADDRESS>Cc: Heather Allemang<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [OfficeDev/office-js-docs-pr] Troubleshoot user errors with Office Add-ins (#1057)
Hi @HeatherAllemanghttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FHeatherAllemang&data=02|01|hallem%40microsoft.com|2dd5557777904be37b7d08d6edd6e5b4|72f988bf86f141af91ab2d7cd011db47|1|0|636957904570504844&sdata=W90hf91qQiJkfejcGn4NDXZDj2sPJtIkD7vC1r3rEHc%3D&reserved=0 - Thanks for reading our docs and for the suggestions! We will go ahead and take them into consideration and add appropriate work items to our backlog. Are you having an "access denied" error that you need assistance with? If so, to help troubleshoot it would be great if you can give me some more details about the situation in which you get this message (what action are you trying to perform, what product are you using, etc). Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FOfficeDev%2Foffice-js-docs-pr%2Fissues%2F1057%3Femail_source%3Dnotifications%26email_token%3DAK6VC2FRCAG5BZRDCCZHW4DPZ2Q7NA5CNFSM4HUC76VKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXK4VXI%23issuecomment-500550365&data=02|01|hallem%40microsoft.com|2dd5557777904be37b7d08d6edd6e5b4|72f988bf86f141af91ab2d7cd011db47|1|0|636957904570514844&sdata=03D8BgQ6pkHGBAYl6zzQKjJCayqJf1ICw93H5kKNyJc%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAK6VC2GQSGYQ4LVSVM5IAQ3PZ2Q7NANCNFSM4HUC76VA&data=02|01|hallem%40microsoft.com|2dd5557777904be37b7d08d6edd6e5b4|72f988bf86f141af91ab2d7cd011db47|1|0|636957904570514844&sdata=L7ch6VjMuY6mw9MQ%2FyLvFHoAPOXm4tVMD3KHy1Cu6Y4%3D&reserved=0.

@HeatherAllemang glad that you were able to find a fix for the issue. Let me know if you need any further assistance - I'm going to close this thread for now, but if you comment on it in the future and ask me to reopen it, I will do! Thanks :)

thanks. Adding the mailbox role perms of 'read/write' which is needed for some office apps resolves the issue where users get the error 'access denied' when trying to use an office add-in.  At least this is one of the scenarios where it fixes the issue.


Added Favorites section in Privacy whitepaper

Rendered article section for review:
https://review.learn.microsoft.com/en-us/microsoft-edge/privacy-whitepaper/?branch=pr-en-us-2771#favorites
Before:
https://learn.microsoft.com/en-us/microsoft-edge/privacy-whitepaper/
Related PR:
https://github.com/MicrosoftDocs/edge-developer/pull/2760 - Added History section in Privacy whitepaper
AB#45872262

Pausing PR, to be reopened later.  Per A.G. email to me, noted in PR2771 chat today, Nov 12 2023.


Data Processing Requirements

I'd like to get an idea of what, at least initially, the data processing requirements are for cognoma.
Here's some questions I think we'll need to answer. Let's discuss here.
How "big" is the data? Number of rows, columns, and bytes?
Can a classifier search run on a single multicore machine?

It looks like scikit-learn has some multithreading ability http://scikit-learn.org/stable/developers/performance.html but this may not be applicable to every machine learning algorithm we want to use.
A single cloud machine can pack quite a punch, even the lower tier machines can have 8 cores and 30 GBs of ram. You can keep going up from there, but it gets more expensive.

Will we need distributed computing for each classifier search?

If we can't compute the classifier on a single machine within a reasonable amount of time (30-120 min?), then we may need to distribute a single classifier search across multiple machines.
Can the algorithms we want to use be distributed? Easily?
If so, how do we distribute? Simple parent/child jobs? Spark? Hadoop?

Where will the cancer data live? How big is it? (goes into the first question)

Flat files on S3/GCS? If we don't need to query, or select subsets of data, this may be ok. Index can be in primary app db.
A postgres database? Usually ok for 1TB or less
A data warehouse? Redshift and BigQuery are available. BigQuery supports nested records as well.

Where will the results live? How big is an individual result set?

Same options as above

How "big" is the data? Number of rows, columns, and bytes?

I posted the preliminary datasets created by dhimmel/cancer-data@ffe66ab26000379adcd7138b8ff39920d4692ef1. Both datasets are sample × gene matrices, with one containing mutation status (for constructing y) and the other containing expression (for x). The datasets contain 7,706 samples (rows). The expression data contains 20,501 genes (columns) and the mutation data contains 30,236 genes (columns).

Where will the cancer data live?

Currently, the datasets are compressed TSVs (flat text files). On my machine, reading the TSV into a pandas.DataFrame takes 78 seconds for the 174 MB expression dataset and 58.1 seconds for the 2 MB mutation dataset. One thing to consider is that we'll often only be interested in a subset of the columns and rows. Therefore, we're wasting time reading rows/columns that are going to be discarded. This will be especially true for the mutation dataset.
So what would be ideal is a storage format for matrix-like files that supports indexed reading of specific rows and columns in Python. Ideally for convenience, the data could be stored and read directly from a file -- no need to have a separate application running to serve it. @awm33 do you have any ideas on what technologies may fit here? I've seen a project use pytables for a similar application. Does anyone have experience with pytables? numpy.memmap also looks promising.

@dhimmel  So you have a wide tables, but few rows.
This is a preliminary set? Will it be expanded beyond the initial 7,706 samples? If it stays relatively small, say under 100k samples, I think files could work.
I assume that any one classifier search would only select 2-25ish genes? Or at least that's what I've heard for the frontend. Then you're really only selecting a very small subset of those matrices.
Both pytables and memmap look like they may fit. Here is the IO options for both http://pandas.pydata.org/pandas-docs/stable/io.html http://docs.scipy.org/doc/numpy/reference/routines.io.html
Are you guys using a mix of pandas and numpy structures? Something to be cognizant of is the performance and multithreading abilities of each structure.
One option would be to prepare the matrices in pytable and or memmap format, upload them to S3/GCS, and load them to the workers ephemeral storage as a cache. This load could happen during instance deploy, application deploy, or maybe a script on the machine as well.
Here's another approach. Uncompressed, these matrices are about 1.2GB, which is small enough to keep cached in a server's memory (assuming 15+GB ram). Maybe you could store an indexed copy of the matrices in-memory? You could keep a copy of the matrices in a pandas DataFrame, select the columns (genes) you want and copy them into a new DataFrame. It looks like DataFrames support indexed querying http://pandas.pydata.org/pandas-docs/version/0.15.0/indexing.html, but someone more familar with pandas may know a better structure. As long as operations againt that structure are thread safe. This also assumes we would recycle processes across jobs.

This is a preliminary set? Will it be expanded beyond the initial 7,706 samples?

I don't expect the sample number to grow substantially. @gwaygenomics, is TCGA still collecting data and expanding?

I assume that any one classifier search would only select 2-25ish genes?

The classifier will train itself on many genes (often the full set of 20,501). Depending on the algorithm, the resulting model may only actually use a small number of genes. The machine learning portion of the project will need to take large subsets of the expression matrix. As far as the results viewer, I'm not sure whether the raw data will be incorporated.

One option would be to prepare the matrices in pytable and or memmap format, upload them to S3/GCS, and load them to the workers ephemeral storage as a cache.

I like this idea. Having the file stored locally provides lot's of versatility for code running on the instance.

Uncompressed, these matrices are about 1.2GB, which is small enough to keep cached in a server's memory

Not a huge fan of this as it creates a dependency on having everything operate through a single python process? Threading in python, although fun, can be cumbersome and problematic due to the GIL. The subsetting of pandas dataframes is easy -- it's the communicating the copied subset to independent Python instances that will be hard.

Are you guys using a mix of pandas and numpy structures?

Unclear at this point. pandas is more user friendly and uses numpy in the backend. numpy is less friendly but may have performance benefits.

This is a preliminary set? Will it be expanded beyond the initial 7,706 samples?

I don't expect the sample number to grow substantially. @gwaygenomics, is TCGA still collecting data and expanding?

TCGA has completed sample collection but more data will be made public eventually. The updated data will include more complete mutation calls, more in depth clinical information, and a complete gene expression matrix. I think it should end up at around 15,000 total samples.
We're working on the cutting edge of cancer genomic data right now with these sets, but cognoma should be flexible enough to handle data updates.

Ok, assuming it's a somewhat linear trend, the dataset will end up being ~3GB.
@dhimmel Yeah, I've never done multithreading in python and the two people I've discussed it with were like "if you need multithreading, don't use python". I think I'll miss how easy Clojure makes threading/concurrency.
But you could still use the caching approach if a process would only be executing one task, but it would be kept around to pick up another task, that I'm assuming would need to use the same matrices. Cycling processes vs long running processes.
I'm not sure what will end up being used. I think a long running worker daemon is ideal, if memory leaks are not an issue in this code. So one or more processes more per instance, each independently communicating with the task queue, running one job at a time.
Generating new processes or child processes would clear out the memory of the previous task, but adds the overhead of managing the processes.

If we're using python 3, https://docs.python.org/3/library/multiprocessing.html looks promising "effectively side-stepping the Global Interpreter Lock by using subprocesses instead of threads"

For applications that are job/task based, concurrent.futures is my favorite method for parallelism in Python. You can use the same API but choose between a backend of multiprocessing or threading.
Multiprocessing escapes the Global Interpreter Lock, but has to pickle (serialize) all data being sent to the subprocess. This will cause a big overhead. If we can find a format that allows for quick/indexed reading from disk that's preferable I think. If not, we should consider the in-memory approach -- I think threading would probably be the way to go, but we should test it out. Lot's of the machine learning functions execute non-python code and are thus likely to release the GIL.

concurrent.futures looks neat. concurrent.futures and/or multiprocessing could be a way for a daemon process to manage per task child processes.
Yeah, doesn't look like there is an easy way to share large amounts of data cross thread/process. In-memory cache may be a premature optimization anyway.
Numpy uses libblas and liblapack. If pandas can tap into those through numpy, it should have good multicore performance.
It looks like experimenting with the indexed file formats is the way to go, maybe trying a few formats.


[KVM] Agent LB Fix: Connections from disabled KVM host agents are refused

Description
This PR introduces a fix for a limitation on the KVM agent load balancing feature.
When a host is in 'Disabled' state and the agent is restarted, then the host is not able to connect to the management server, staying indefinitely in 'Connecting' state
2019-10-04 05:23:12,242 DEBUG [c.c.r.ResourceState] (AgentConnectTaskPool-5:ctx-e3780a57) (logid:7c4cc142) Resource state update: [id = 4; name = trl-65-k-M7-nvazquez-kvm4; old state = Disabled; event = InternalCreated; new state = Disabled]
2019-10-04 05:23:12,242 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-5:ctx-e3780a57) (logid:7c4cc142) Transition:[Resource state = Disabled, Agent event = AgentConnected, Host id = 4, name = trl-65-k-M7-nvazquez-kvm4]
2019-10-04 05:23:12,248 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-5:ctx-e3780a57) (logid:7c4cc142) Failed to handle host connection:
java.lang.IndexOutOfBoundsException: fromIndex = -1
	at java.util.SubList.<init>(AbstractList.java:620)
	at java.util.RandomAccessSubList.<init>(AbstractList.java:775)
	at java.util.AbstractList.subList(AbstractList.java:484)
	at org.apache.cloudstack.agent.lb.algorithm.IndirectAgentLBRoundRobinAlgorithm.sort(IndirectAgentLBRoundRobinAlgorithm.java:44)
	at org.apache.cloudstack.agent.lb.IndirectAgentLBServiceImpl.getManagementServerList(IndirectAgentLBServiceImpl.java:93)
	at org.apache.cloudstack.agent.lb.IndirectAgentLBServiceImpl.compareManagementServerList(IndirectAgentLBServiceImpl.java:101)
	at com.cloud.agent.manager.AgentManagerImpl.handleConnectedAgent(AgentManagerImpl.java:1094)
	at com.cloud.agent.manager.AgentManagerImpl.access$000(AgentManagerImpl.java:126)
	at com.cloud.agent.manager.AgentManagerImpl$HandleAgentConnectTask.runInContext(AgentManagerImpl.java:1187)
	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019-10-04 05:23:12,248 WARN  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-5:ctx-e3780a57) (logid:7c4cc142) Unable to create attache for agent: Seq 0-0:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 1, [{"com.cloud.agent.api.StartupRoutingCommand":{"cpuSockets":3,"cpus":3,"speed":1599,"memory":7277121536,"dom0MinMemory":1073741824,"poolSync":false,"supportsClonedVolumes":false,"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"Host.OS.Kernel.Version":"3.10.0-957.12.2.el7.x86_64","com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS.Version":"7.6.1810","secured":"true","Host.OS":"CentOS"},"hostTags":[],"groupDetails":{},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"d609214d-020e-3727-8515-c58c792f1d1a-LibvirtComputingResource","name":"trl-65-k-M7-nvazquez-kvm4","id":0,"version":"<IP_ADDRESS>-SNAPSHOT","iqn":"iqn.1994-05.com.redhat:213e8ff8bef8","privateIpAddress":"<IP_ADDRESS>","privateMacAddress":"1e:00:56:01:07:47","privateNetmask":"<IP_ADDRESS>","storageIpAddress":"<IP_ADDRESS>","storageNetmask":"<IP_ADDRESS>","storageMacAddress":"1e:00:56:01:07:47","resourceName":"LibvirtComputingResource","gatewayIpAddress":"<IP_ADDRESS>","msHostList":"<IP_ADDRESS>,<IP_ADDRESS>@roundrobin","wait":0}},{"com.cloud.agent.api.StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"a1708750-e55c-4b15-89b3-2b9cc39b6a77","host":"<IP_ADDRESS>","localPath":"/var/lib/libvirt/images","hostPath":"/var/lib/libvirt/images","poolType":"Filesystem","capacityBytes":20935868416,"availableBytes":19100352512},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"d609214d-020e-3727-8515-c58c792f1d1a-LibvirtComputingResource","name":"trl-65-k-M7-nvazquez-kvm4","id":0,"version":"<IP_ADDRESS>-SNAPSHOT","resourceName":"LibvirtComputingResource","msHostList":"<IP_ADDRESS>,<IP_ADDRESS>@roundrobin","wait":0}}] }
2019-10-04 05:23:12,263 WARN  [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) Throwing away a request because it came through as the first command on a connect: Seq 0--1:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 111, [{"com.cloud.agent.api.ShutdownCommand":{"reason":"sig.kill","wait":0}}] }
2019-10-04 05:23:12,395 WARN  [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) Throwing away a request because it came through as the first command on a connect: Seq 0-1:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11, [{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetAccessible":true,"hostType":"Routing","hostId":0,"wait":0}}] }
2019-10-04 05:23:13,320 INFO  [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Connection from /<IP_ADDRESS> closed but no cleanup was done.

The main reason is that when the administrator changed the value of the global configurations host or indirect.agent.lb.algorithm, the LB mechanism in the management server sent the updated values of these configurations only to the hosts in 'Enabled' state. In particular, hosts in 'Disabled' state did not receive the updated management server list (and LB algorithm).
Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):
How Has This Been Tested?
In a KVM environment:
Case 1:

Disable a host H
Restart agent on host H
Verify that the host is 'Up'

Case 2:

Disable a host H
Update one of the global settings: host or indirect.agent.lb.algorithm
Verify that agent in host H receives the updated values of the configurations

@blueorangutan package

@nvazquez a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-306

@blueorangutan test

@nvazquez a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-327

@blueorangutan test

@andrijapanicsb a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-476)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31357 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3617-t476-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_01_redundant_vpc_site2site_vpn
Failure
391.45
test_vpc_vpn.py

@blueorangutan package

@andrijapanicsb a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-385

@blueorangutan test

@andrijapanicsb a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

LGTM.
Tested manually as following:

TestID
Test Name
Steps
Expected Result
Status

1
New configuration values are propagated   to host in “Disabled” state
Disable a host. Change value of the   “host” and/or “indirect.agent.lb.algorithm”  global settings.
Observe the content of the   /etc/cloudstack/agent/agent.properties contain the new values, even though   the host is still Disabled.
Pass

2
New   setting values are propagated to the host in the PrepareForMaintenance
Put   host in maintenance mode. While the host is in the PrepareForMaintenance state,   change the values of “host” and/or “indirect.agent.lb.algorithm”.
Observe   the content of the /etc/cloudstack/agent/agent.properties contain the new   values from the “host” and/or ” indirect.agent.lb.algorithm” almost   immediately (i.e. no more than few seconds after the values are changed via   API call)
Pass

3
New configuration values are propagated   to the host that is already in Maintenance mode
Put host in maintenance mode. After the   host is in the Maintenance state, change the values of “host” and/or “indirect.agent.lb.algorithm”.
Observe the content of the   /etc/cloudstack/agent/agent.properties contain the new values from the “host”   and/or ” indirect.agent.lb.algorithm” almost   immediately (i.e. no more than few seconds after the values are changed via   API call)
Pass

5
Host   is able to connect back to management server, after the restart
Disable   the host.    Change   the values of “host” and/or “indirect.agent.lb.algorithm”.   Restart the   cloudstack-agent on the host
Observe   that host will temporarily be in the “Connecting” state and will eventually   transition to the “Up” state (connected to a management server)
Pass

6
A host doesn’t require agent restart in order to exit Maintenance mode
While having "kvm.ssh.to.agent" seto to false , put the host into the Maintenance mode.   Do NOT restart cloudstack-agent .   Cancel the Maintenance mode for the host
Observe that host “Resource state” will transition from “Maintenance” to “Enabled”
Pass

Trillian test result (tid-543)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36069 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3617-t543-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_iso.py
Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_02_redundant_VPC_default_routes
Failure
310.31
test_vpc_redundant.py

test_05_rvpc_multi_tiers
Failure
422.18
test_vpc_redundant.py

test_05_rvpc_multi_tiers
Error
448.61
test_vpc_redundant.py

@blueorangutan test

@andrijapanicsb a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan test

@andrijapanicsb a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-551)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37276 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3617-t551-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

LGTM.
(Extensive manual testing)

Just to keep track on PRs vs Issues. This fixes #3581.

Thanks @andrijapanicsb and @GabrielBrascher, have also added the Issue number on the description after Gabriel's comment

@blueorangutan package

@nvazquez a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-416

@blueorangutan test

@nvazquez a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-572)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36554 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3617-t572-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Merging based on reviews and test results


GitHub action multi cluster deploy

Creating GitHub Action Narrative and script

I think it should modify prior sections to ensure the users fork the repo.


Vehicle previewer breaks if two players begin a vehicle purchase

To fix this issue, the halo preview and variables that hold the vehicle data need to be set to "self." on the SWEP's logic. This might be difficult to accomplish with the current implementation, but should be reasonably doable with some refactoring. Mark for followup.

See the base preview on how this issue was accomplished for that tool.

Issue has been fixed as of commit number da2f922c3758d9de66f6744b67d81d1c0f88f6a4


Resolve issue with brake light alert on dash cluster

Recently the "brake lamp" light came on in the dash cluster. The light is supposed to notify you of when your brake lights are out, but a quick google search showed the problem might actually just be a switch under the steering column.
TODO

[x] Test brake lights to see if they actually are on or need replaced
[ ] if need replaced, replace; else, check for switch under steering column

Fixed via new bulb


Fix CI with meson

On the current Travis CI, we support

Ubuntu 16.04
Ubuntu 18.04
Ubuntu 20.04

These platforms have different version of the Meson build system:

Ubuntu
Meson
End of Standard Support
End of Life

16.04 (LTS)
0.29
April 2021
April 2026

16.04 Update (LTS)
0.40.1
April 2021
April 2026

18.04 (LTS)
0.45.1
April 2023
April 2028

18.04 Update (LTS)
0.45.1
April 2023
April 2028

20.04 (LTS)
0.53.2
April 2025
April 2030

Unfortunately, some feature we use doesn't not exist in old version of meson, namely

From 0.36, the command was renamed from meson.py to become meson
From 0.42, setup sub-command is added
From 0.54, compile command gained -C option

That said, even with 16.04 with updates, we can't really support Meson 0.29.

Meson is too old
It's already End of Standard Support

If we are OK to support 18.04 and 20.04, we can set the minimum version to 0.45.1.

Let's just remove the two older ones and support from 20.04 and up. It also uses less CI ressources.
We should consider ARM and AVR as build targets.


Some files cannot be uploaded

Just chilling and uploading some boot managers...
413 error is received when this file is uploaded in unzipped form.
The HTTP 413 Payload Too Large response status code indicates that the request entity is larger than limits defined by server; the server might close the connection or return a Retry-After header field.
Definitely not too large (~1.5MB) so worth checking this out.
bootmgr.zip

Probably makes sense after all, we probably have wrong env setup right now so the limit is at 1MB instead of the default 250MB


Add KDE Logo

KDE Logos
See KDE and kde.org

Added in 17261479e64d27613dfd2f71e66eefae38b3d698
Thanks

Added in 17261479e64d27613dfd2f71e66eefae38b3d698
Thanks


Ability to adjust theme elements

I have 920 Editor on a 7" Android tablet.  I normally use the Light theme.  On my screen, there elements can be a challenge to read, as in the screenshot below.
https://drive.google.com/open?id=0ByMy9Nx6Q5CiVlN2OXhwNGRjRGM
I'd like to be able to increase the font size in theme elements, and change the background color for better visibility.
>Dennis

Hi,
Thank you for your feedback first!
I am busy recently, if I have free time, I will collect your suggestions, and make a decision.

That's fine.  I understand you have other things to do beside develop 920.  The need isn't critical, and I can wait till you have some time to look at it.  I just wanted to get the issue noted and into the tracker so it will be there when you do have time to look.
I'm just happy to see the 920 Editor and you back and development proceeding.
>Dennis


RKE2 based provisioning fails on vmware

Rancher Server Setup

Rancher version: master-head
Installation option (Docker install/Helm Chart):

If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc):  v1.21.3+k3s1

Proxy/Cert Details: letsEncrypt

Information about the Cluster

Kubernetes version: any RKE2
Cluster Type (Local/Downstream): Downstream

If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider): vmware node driver

Describe the bug

On current master-head provisioning a RKE2 based cluster on vmware fails if the network name has a space.
A sample vmwarevspheremachinetemplate is as follows:
apiVersion: rke-machine.cattle.io/v1
kind: VmwarevsphereMachineTemplate
metadata:
  name: vmware-grke2m
  namespace: fleet-default
spec:
  clusterName: vmware
  template:
    spec:
      boot2dockerUrl: ""
      cfgparam:
      - disk.enableUUID=TRUE
      cloneFrom: /RNCH-HE-FMT/vm/openSUSE-Leap-15.2-Rancher-Tmpl
      cloudConfig: |+
        #cloud-config
      cloudinit: ""
      common:
        cloudCredentialSecretName: vmware
      contentLibrary: ""
      cpuCount: "2"
      creationType: template
      customAttribute: []
      datacenter: /RNCH-HE-FMT
      datastore: /RNCH-HE-FMT/datastore/ranch01-silo02-vm01
      datastoreCluster: ""
      diskSize: "20000"
      folder: null
      hostsystem: __SENTINEL__
      memorySize: "2048"
      network:
      - /RNCH-HE-FMT/network/Private Range <IP_ADDRESS>-21
      password: ""
      pool: /RNCH-HE-FMT/host/FMT2.R620.1/Resources/gmehta
      sshPassword: tcuser
      sshPort: "22"
      sshUser: docker
      sshUserGroup: staff
      tag: []
      username: ""
      vappIpallocationpolicy: null
      vappIpprotocol: null
      vappProperty: []
      vappTransport: null
      vcenter: ""
      vcenterPort: "443"

To Reproduce

Create a cluster on vmware with the sample settings in the machine pool.
Result
Cluster provisioning fails
k get machine
NAME                             PROVIDERID   PHASE    VERSION
vmware-grke2w-55c7956499-tql44                Failed
vmware-grke2m-f6d76f6bb-gxp4p                 Failed

Reason for failure in the machine status
Failure Message:         Failure detected from referenced resource rke-machine.cattle.io/v1, Kind=VmwarevsphereMachine with name "vmware-grke2m-6b4l4": Invalid command line. Found extra arguments [<IP_ADDRESS>-21 --vmwarevsphere-pool=/RNCH-HE-FMT/host/FMT2.R620.1/Resources/gmehta --vmwarevsphere-ssh-password=tcuser --vmwarevsphere-ssh-port=22 --vmwarevsphere-ssh-user-group=staff --vmwarevsphere-ssh-user=docker --vmwarevsphere-vcenter-port=443 vmware-grke2m-6b4l4]
  Failure Reason:          CreateError

Expected Result

Cluster should provision correctly.
Screenshots

Additional context
<!--Add any other context about the problem here.—>

@ibrokethecloud Does this network config work with RKE1?

Hi @deniseschannon it works fine with RKE1 based clusters. The issue is likely the non escaping of string values when calling the machine driver in the provision job.
    Image:      rancher/machine:v0.15.0-rancher65
    Port:       <none>
    Host Port:  <none>
    Args:
      --driver-download-url=
      --driver-hash=
      --secret-namespace=fleet-default
      --secret-name=vmware2-grke2a-dcjzs-machine-state
      create
      --driver=vmwarevsphere
      --custom-install-script=/run/secrets/machine/value
      --vmwarevsphere-cfgparam=disk.enableUUID=TRUE
      --vmwarevsphere-clone-from=/RNCH-HE-FMT/vm/openSUSE-Leap-15.2-Rancher-Tmpl
      --vmwarevsphere-cloud-config=/path/to/machine/files/cloud-config
      --vmwarevsphere-cpu-count=2
      --vmwarevsphere-creation-type=template
      --vmwarevsphere-datacenter=/RNCH-HE-FMT
      --vmwarevsphere-datastore=/RNCH-HE-FMT/datastore/ranch01-silo02-vm01
      --vmwarevsphere-disk-size=20000
      --vmwarevsphere-hostsystem=__SENTINEL__
      --vmwarevsphere-memory-size=2048
      --vmwarevsphere-network=/RNCH-HE-FMT/network/Private Range <IP_ADDRESS>-21
      --vmwarevsphere-pool=/RNCH-HE-FMT/host/FMT2.R620.1/Resources/gmehta
      --vmwarevsphere-ssh-password=tcuser
      --vmwarevsphere-ssh-port=22
      --vmwarevsphere-ssh-user-group=staff
      --vmwarevsphere-ssh-user=docker
      --vmwarevsphere-vcenter-port=443

I'm not able to create an rke2 vsphere node driver cluster.

Created cloud credentials for vsphere and all the fields under scheduling are stuck in loading.
Same credentials work for rke1 clusters and the cluster comes up active.

Note: Tried creating cloud credentials from ember UI as well as /v3/cloudcredentials and the vsphere cluster creation won't work in all of the cases.

blocked by https://github.com/rancher/dashboard/issues/3655

Verified on v2.6-head by creating templates with network /RNCH-HE-FMT/network/Private Range <IP_ADDRESS>-21 and without the network for nodes in the same cluster.
Cluster has come up fine without any errors.


insert an error

Fixes #.
Description of the changes:

How changes were validated:

shouldn't be WRONGparameters