To support Active Directory authentication

These are the changes needed to allow authentication with Active Directory using LDAP Simple Authentication.
In Active Directory the user DN doesn't usually contain the user ID. Most look like this  cn:Jane Doe, cn=users, dc=domain, dc=org.  When using the simple bind LDAP, we would have to use the User full name as their login if we want to also use the same DN to search for the user info in AD. Therefore separating the value we use to bind to LDAP and the one we use for searching solve allows us to authenticate with AD.

we can use the userPrincipalName to bind with Active Directory and a UserDN to search. Also, as the User DN we use to search for the user doesn't have the user ID, using fmt.sprintf is failing.

Codecov Report

Merging #2969 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master   #2969   +/-   ##
======================================
  Coverage    26.8%   26.8%
======================================
  Files          90      90
  Lines       17807   17807
======================================
  Hits         4774    4774
  Misses      12353   12353
  Partials      680     680

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 183da4c...999bf95. Read the comment docs.

Something looks wrong to me... User filter is not meant to be find specific user but to filter users by group/attributes that if matched he can login

I'm very new coding with Go, so I may be doing it totally wrong. The issue, and before making the code change, I've tried unsuccessfully making it work with LDAP (BindDN) or LDAP simple auth. I'm trying to get the user authenticate with AD without having to store a Bind Password.
My user DNs look like this cn=Jane Doe, cn=users, dc=domain, dc=org. Without any changes, to use LDAP simple auth. My User DN format would need to look like cn=%s, cn=users, dc=domain dc=org. However, if I set that as my user DN, then the user would need to login using their full name as the user name (e.g: 'Jane Doe') in order for the bind not to fail and also be able to retrieve the user attributes afterward. It will work but it's confusing to the user because everywhere else they sign in with either their username or their email address but not with the full name.
To use the user name, I tried changing the user DN to<EMAIL_ADDRESS>This works partially. the user can authenticate because bindUser(l, userDN, passwd) does not return an error; however, the next call ldap.NewSearchRequest(...) fails because the userDN is not really a valid DN for searching. Now, if it only performed the binding and didn't do the search, it would work fine for me.
The changes that I made was to use one value for binding and another for searching. If I bind with userPrincipalName<EMAIL_ADDRESS>and search with the UserDN as the base with the filter to find the user.
This may be the wrong approach because it's seems like an hybrid of LDAP (Simple auth) and LDAP (BindDN) but my Go lang skills are limited to be able to add a new authentication type for AD. The hybrid approach worked for me, so I thought, I should share.

Thank you for submitting PR :) I was not saying that it's wrong just that some field usage seems wrong. I'll try to look into this issue next week.

I think these changes are not needed try setting values like this in current gitea version without this PR:

Full user filter:
(&(objectCategory=Person)(memberOf=CN=Users,OU=domain,DC=domain,DC=org)(sAMAccountName=%s)(!(UserAccountControl:1.2.840.1135<IP_ADDRESS>3:=2)))

Hi Lauris,
I have a similar issue with trying to connect gitea to our AD at work. A service account unfortunately is not an option, so the LDAP via BindDN is no option and I have to use LDAP simple auth to do the bind using the credentials provided by the end-user.
The settings I provided are:

User DN<EMAIL_ADDRESS>( &<EMAIL_ADDRESS>(memberOf=CN=CN=YYYYYYYYY,OU=Applications,OU=Groups,OU=XXXX,DC=aa,DC=bb,DC=cc,DC=dd))
(based on your suggestions in the comment above, adapted to the needs in my case)

The (Trace-level) logs I get when I try to login with my credentials are:
2018/05/09 18:51:52 [T] Dialing LDAP with security protocol (0) without verifying: false 2018/05/09 18:51:52 [T] LDAP will bind directly via UserDN template<EMAIL_ADDRESS>2018/05/09 18:51:52 [T] Binding with userDN<EMAIL_ADDRESS>2018/05/09 18:51:52 [T] Bound successfully with userDN<EMAIL_ADDRESS>2018/05/09 18:51:52 [T] Fetching attributes '', 'givenName', 'sn', 'mail' with filter (&(userPrincipalName=IDxxxxxx@aa.bb.cc.dd)(memberOf=CN=YYYYYYYYY,OU=Applications,OU=Groups,OU=XXXX,DC=aa,DC=bb,DC=cc,DC=dd)) and base<EMAIL_ADDRESS>2018/05/09 18:51:52 [...dels/login_source.go:390 LoginViaLDAP()] [E] LDAP Search failed unexpectedly! (LDAP Result Code 34 "Invalid DN Syntax": 0000208F: NameErr: DSID-031001D1, problem 2006 (BAD_NAME), data 8350, best match of<EMAIL_ADDRESS>) 2018/05/09 18:51:52 [W] Failed to login 'IDxxxxxx' via 'LDAP_AD': user does not exist [uid: 0, name: IDxxxxxx, keyid: 0] 2018/05/09 18:51:52 [D] Template: user/auth/signin 2018/05/09 18:51:52 [I] Failed authentication attempt for IDxxxxxx from <IP_ADDRESS>
From what I understand AD allows you to not only use a DN when binding, but also allows you to use the UPN<EMAIL_ADDRESS>in my case) to bind. This assumption indeed seems to be correct when I look at the log: successfully bound with userDN.
However, the next step is an LDAP search which does not work because the UPN cannot be used as a base to search. I tried to replicate the same in a small python program using python-ldap module and there I see the same behavior: I can bind using the UPN, but I cannot use the UPN as a base for the search.
Would it be possible to add an additional attribute in the LDAP simple auth configuration screen that indicates the base DN to use for a search? If not filled in, the userDN can be used, and if this optional base DN is filled, the base DN overrules the userDN for the search base DN?
Or is there any other way to enforce a correct base DN for the search?

@lafriks I am having the same issue with trying to get Active Directory working. I can confirm that @malweka and @gdiepen are correct. There is no way to get Active Directory working for gitea using LDAP (simple auth) with the current code in gitea. This pull request is needed in order to allow it to work. Please merge this and create a release with the fix. Thank you.


improve default sandbox option strings to ignore tests & test directories

context: sandbox workarounds needed to work with React - part of issue #2403

Closing in favor of #2412


Use installed ghc in stack linux builds

To avoid download it again and not waste disk space
Fixes #1729
The builds are failing due to timeouts when executing stack exec hoogle generate: see https://github.com/ndmitchell/hoogle/issues/347

I am afraid that the actual configuration is not valid for wrapper-test, cause it assumes that stack will have the correct ghc downloaded or in path. It needs up to two different ghcs (ghc-8.8.1 and ghc-8.6.5) so not sure if it will be enough space for both although we are not downloading the main one, the used to build everything else.

How about we mock the wrapper tests? You think that is possible?

Idea for test-mocking:

Add a number of scripts named ghc-* where * is the GHC version
Each of these scripts only know the parameter --numeric-version
When running wrapper tests, we do something like export PATH=/path/to/scripts:$PATH
For stack, set system-ghc: True.

Mmm, interesting, but stack with system-ghc needs an executable ghc (without the version suffix) in path, no (i have to test it)? could we cheat stack and make it think that the script is ghc?
In fact, we have the real ghcs! so we could point to the appropiate one for each test. This can be done manually running each test separately and set the path with the appropiate ghc in the bash script.

but stack with system-ghc needs an executable ghc (without the version suffix) in path, no? (i have to test it)
I was wrong, stack picks a ghc-${version} in path if it needs it so the solution is simpler than i thought: we can set in path the needed ghcs, putting the main one in first place

Ok, the stack linux jobs that has not failed due to the response timeout are successful now, so i think the pr could be merged


angular-formly: Combined DateTimePicker

Latest:
Issue: https://github.com/formly-js/angular-formly-website/issues/39
With bootstrap-datetimepicker custom directive (JQuery dep ): )
Repo: https://github.com/dalelotts/angular-bootstrap-datetimepicker
Experiment
http://jsbin.com/doleriz/1/edit?js,console,output
Fork Hierarchy:

https://github.com/smalot/bootstrap-datetimepicker

https://github.com/eternicode/bootstrap-datepicker

http://www.eyecon.ro/bootstrap-datepicker/

With DatePicker & TimePicker
Branch: iss15-ui.date-time.picker
Original issue: https://bitbucket.org/panaxit/panaxui-angularjs/issue/15/angular-formly-use-angularui-datepicker
Experiment
http://jsbin.com/gikave/2/edit?js,console,output

Option 1: In Backend

FieldGroup (with flex) with

Option 1: In Frontend

Custom type template

Better Alternative? https://github.com/Gillardo/bootstrap-ui-datetime-picker

Dear all, There is one more alternative which I spent lots of time to find such a compact solution;
JS Bin


added Test for getHotNews

Coverage increased (+1.7%) to 76.292% when pulling eafc1fc20533c588bac5a212a2b8f4ed09b89bb5 on ljbergmann:master into 1eda58a29f477bcb927410c94c28170ba7b4003a on Alpha-Trader:master.


How to customize the running name of Evaluations

How to customize the running name of Evaluations. The current default value is Evaluations.evaluate. How should I customize this value in the py code? My current method of operation is to manually edit it on the H5 page.

Hi @madroidmaq,
To customize the display name of a call of eval you can
```python showLineNumbers
import weave

# Initialize the client
client = weave.init("your-project-name")

# Get a specific call by its ID
call = client.get_call("call-uuid-here")

# Set the display name of the call
call.set_display_name("My Custom Display Name")
```

Let me know if that answers your question or if you need anything else.

@jwlee64 Thank you for your reply.
The code I use to evaluate the dataset is roughly as follows. How should I obtain the call_id information corresponding to the current evaluation?
def run_eval():

    image_model = FoodImageWorkflowModel(
        system_prompt=system_prompt,
        version=run_version,
        ....
    )

    evaluation = Evaluation(
        name='food_image',
        dataset=datas,
        scorers=[
            FoodScorer(output_file=output_file)
        ],
    )

    client = weave.init('food-eval')
    asyncio.run(evaluation.evaluate(image_model))

    print(f"image_model:\n{image_model}")

Hi @madroidmaq
Sadly there is no way to prettily get the last call of the evaluation and set the display name. I am going to ticket these 2 things and raise to the team.

Get call id of evaluation.evaluate in summary object
Set display name of evaluation on evaluate

I do have a code snippet that should hopefully unblock.
Because evaluate within the Evaluation object is an op, we can get the calls of that op, and sort for the most recently called.
# Define the evaluation
evaluation = Evaluation(name="cool_eval", dataset=examples, scorers=[match_score1])

# Init
client = weave.init("simple_eval")

# Run the evaluation
eval_result = asyncio.run(evaluation.evaluate(function_to_evaluate))

# Get the ref uri of the evaluation
op_uri = evaluation.evaluate.ref.uri()
username = "jwlee64"  # add your username

# Get calls of the evaluation sorting for most recent, limit 1
calls = client.server.calls_query(
    {
        "project_id": f"{username}/simple_eval",
        "filter": CallsFilter(op_names=[op_uri]),
        "sort_by": [{"field": "started_at", "direction": "desc"}],
        "limit": 1,
    }
)

# Get the most recent call
call = client.get_call(calls.calls[0].id)

# Set the display name of the call
call.set_display_name("My Custom Display Name")

Hopefully this helps

hi @jwlee64 ，its worked for me，thanks.
Looking forward to the improvements you mentioned to subsequent APIs.


Create how-to.md

@JasonMorgan was going to help with the images. I was running into issues. I actually thought this was still on my own branch 🤦🏻♀

The first image is called sc1.png. Also please give the images unique names.


unary response has zero messages due to io.EOF for all io.EOF errors

Describe the bug
After updating our dependency from 1.15.0 to 1.16.2, we started to see the error unary response has zero messages returned where we previously used to see io.EOF. https://github.com/connectrpc/connect-go/pull/712 appears to have caused the behavioral change to return connect.CodeUnimplemented instead of io.EOF for all cases of io.EOF which can come from general network/transport errors and nothing to do with the gRPC doc linked in the PR. We were relying on io.EOF in a client interceptor to automatically retry requests since we can occasionally see the error due to network flakiness and have since updated to check for the connect.Unimplemented code and error now.
To Reproduce
I couldn't really come up with a great way to provide a reproducible test for this but am happy to do so if it's a blocker.
Environment (please complete the following information):

connect-go version or commit: v0.16.2
go version: go version go1.23.0 linux/amd64

this is for unary RPCs using the Connect protocol, right?

Correct and sorry I wasn't more explicit with the protocol used.

My comment in that PR was

So while it doesn't fully resolve #774, it should help a lot.

And yet GitHub decided to auto-close this issue when that PR was merged 😞.
Since it's not fully resolved, I want this issue left open. So re-opening...


Explorer crashes after attempting to copy any file, without copying them

Describe the bug
Selecting any file or folder, or groups of either, and attempting to copy it results in the application crashing
To Reproduce
Steps to reproduce the behavior:

Open two windows or tabs
On one tab/window, choose a file to copy
On the other tab/window, choose a folder to copy that file into
See error

Expected behavior
Application crashes without copying files
Screenshots
If applicable, add screenshots to help explain your problem.
I've done a screen recording
Files - Preview 2020-09-30 12-50-04.zip
Desktop (please complete the following information):

OS: [e.g. Windows 10 1903 18362.175]
App version: latest version as of today

Additional context
None
Log file
Please post the log file here so that we can understand your problem better. You can access it from Settings->About->Open log location.
debug.txt

@Gizmotronn Explorer crashes or Files UWP crashes?

Files UWP, sorry

@Gizmotronn What version of the app are you using?

Latest version from the releases as of today.

@Gizmotronn Can you confirm that it's v0.15.4?

0.15.0 actually, my mistake @yaichenbaum

@Gizmotronn Does it still exist in v0.15.4?

Hello, i got the same Problem in <IP_ADDRESS>. Error Logs also write "Access Denied" but i have Access to the Source and Destination Path.
debug.txt

There's a potential improvement in this area being authored by @gave92 with #2269 . I'm going to close this since we already have other issues tracking the exceptions.


patchPluginXml task strips CDATA from plugin.xml

When I'm trying to use buildPlugin task, every CDATA inside plugin.xml is stripped, and sometimes according tags braces are encoded (not every time).

What's wrong with it?

I'm not sure about rendering inside IDE, but it can really break formatting. So, instead of section
<change-notes><![CDATA[         0.0.1

Initial release

     ]]>     </change-notes>
I have this:
<change-notes>         0.0.1

Initial release

     </change-notes>
or this:
<change-notes>         <b>0.0.1</b>         <ul>             <li>Initial release</li>         </ul>     </change-notes>

You may check this in IDE, but it looks like absolutely valid xml to me that will be rendered in the same way as xml with CDATA.

<change-notes>

This was outer of CDATA, was it also converted?

Well, <![CDATA[ 0.0.1

Initial release

 ]]>  is a string body; and 0.0.1

Initial release

 are nested XML tags, and I don't think they are equivalent, and will be rendered the same way. I can possibly have another HTML structure that probably will break the XML (for example — have </change-notes> inside CDATA).

hold on, initially you said that
<![CDATA[ 0.0.1

Initial release

 ]]>
replaced by
<b>0.0.1</b> <ul> <li>Initial release</li> </ul>
This is completely valid replacement.

I can possibly have another HTML structure that probably will break the XML (for example — have  inside CDATA).

It won't break anything becuase < and > will be escaped.

Yes, replacement with html encoding is valid, but in some cases (if I'll find steps to 100% reproduce — I'll provide it) plugin was just stripping CDATA part, leaving all tags inside it.

Ok then, closing for now, please ping me if you'll be able to recreate this


How could we scroll to next or previous?

swiperController.next()   doesnt change the view to next.

Any update on this?


networkd being enabled breaks switching to new generation

Describe the bug
After updating to rev 505386dda29452140f93734509b03de57986af57 I can't nixos-rebuild switch anymore on my laptop. Switch fails with
$ sudo nixos-rebuild switch --flake .
building the system configuration...
activating the configuration...
setting up /etc...
reloading user units for bene...
restarting sysinit-reactivation.target
warning: the following units failed: systemd-networkd-wait-online.service

× systemd-networkd-wait-online.service - Wait for Network to be Configured
     Loaded: loaded (/etc/systemd/system/systemd-networkd-wait-online.service; enabled; preset: enabled)
    Drop-In: /nix/store/bbb5i83nv425cm9r2kadx8mvlglv2vwx-system-units/systemd-networkd-wait-online.service.d
             └─overrides.conf
     Active: failed (Result: exit-code) since Mon 2024-11-18 10:42:18 CET; 58ms ago
       Docs: man:systemd-networkd-wait-online.service(8)
    Process: 64823 ExecStart=/nix/store/h05qs7dk5i6490ji0f9fndia9q2wwjac-systemd-255.9/lib/systemd/systemd-networkd-wait-online --timeout=120 (code=exited, status=1/FAILURE)
   Main PID: 64823 (code=exited, status=1/FAILURE)
         IP: 0B in, 0B out
        CPU: 6ms

Nov 18 10:40:18 pulse-14 systemd[1]: Starting Wait for Network to be Configured...
Nov 18 10:42:18 pulse-14 systemd-networkd-wait-online[64823]: Timeout occurred while waiting for network connectivity.
Nov 18 10:42:18 pulse-14 systemd[1]: systemd-networkd-wait-online.service: Main process exited, code=exited, status=1/FAILURE
Nov 18 10:42:18 pulse-14 systemd[1]: systemd-networkd-wait-online.service: Failed with result 'exit-code'.
Nov 18 10:42:18 pulse-14 systemd[1]: Failed to start Wait for Network to be Configured.
warning: error(s) occurred while switching to the new configuration

I'm think this is related to the change introduced in https://github.com/numtide/nixos-facter-modules/commit/b4beb32149a16d15220e307ca4c9d7ff4eddc3ce in combination with https://github.com/numtide/nixos-facter-modules/commit/cbbb0f780bddc5648ca4ee33a6c788e07c971776 (the latter fixing the enabled state of the module).
To Reproduce
Not sure it's possible to reproduce it without my machine. I guess you could build a vm from https://github.com/britter/nix-configuration rev aca40ed12989136e8807a2a572cf3c22e199d284. Enabling this configuration fails unless facter.detected.dhcp.enable = false.
Expected behavior
Using facter-modules does not break networking or switching to a new generation.
System information

Additional context

That's actually an issue with networkd. We have disabled the wait-online.target everywhere without having had any downsides: https://github.com/nix-community/srvos/blob/e26a814735f50034e35dff637efad2d502698d09/nixos/common/networking.nix#L16

Can't tell. I guess you had a reason for enabling it in https://github.com/numtide/nixos-facter-modules/commit/b4beb32149a16d15220e307ca4c9d7ff4eddc3ce.


PR: Don't wait for disconnected comm

Description of Changes
Stop waiting on disconnected comms. Instead:
If interrupting: don't interrupt and send via regular channel.
If blocking: raise an error and let the calling function handle the error

[ ] Wrote at least one-line docstrings (for any new functions)
[ ] Added unit test(s) covering the changes (if testable)

[ ] Included a screenshot or animation (if affecting the UI, see Licecap)

Issue(s) Resolved

Fixes #13288
Affirmation
By submitting this Pull Request or typing my (user)name below,
I affirm the Developer Certificate of Origin
with respect to all commits and content included in this PR,
and understand I am releasing the same under Spyder's MIT (Expat) license.

I certify the above statement is true and correct:

Hello @impact27! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file spyder/plugins/ipythonconsole/comms/kernelcomm.py:

Line 150:29: E127 continuation line over-indented for visual indent

This looks pretty good, thanks @impact27!
My only concern is that you're removing interrupt=True from a lot of calls, which I thought was necessary while debugging.

All the calls that use blocking=True need interrupt=True, so I just changed it so blocking implies interrupt.

@impact27, is this one ready?

@ccordoba12 yes


Question about latent supervision.

Thanks for your amazing work! I'd like to ask about latent supervision. I think it is similar to PETR approach with a set of queries cross attention with 3D PE + image features. Then these queries are quantized and cross attention to decode waypoints only. Do you use pretrained PETR model or use intermediate supervision? Only using waypoint as supervision is similar to BEV-planner approach with a sparse paradigm. I'm really curious about it. Thanks again.

Our latent supervision is not related to PETR. We only utilize PETR's 3D PE  to enhance the image feature, without using a pretrained PETR model or intermediate supervision. The latent supervision comes from the latent world model and waypoints.

Thanks for your answers. Look forward to your code!


Tests fail under CLI sbt

[error] Uncaught exception when running tests: java.lang.NoClassDefFoundError: edg_ide/edgir_graph/NodeDataWrapper

and when expanded using last Test / test:
[error] Uncaught exception when running tests: java.lang.NoClassDefFoundError: edg_ide/edgir_graph/NodeDataWrapper
[error] sbt.ForkMain$ForkError: java.lang.NoClassDefFoundError: edg_ide/edgir_graph/NodeDataWrapper

No idea why, but is remarkably consistent across platforms and machines, and even when bumping the sbt and Scala version to latest (1.5.5, 2.13.6 respectively). Seems like this has been a issue for a while, but perhaps not surfaced because tests were being run in IntelliJ.

Obsoleted? CLI tests seem to work now


New features for pathway identification and charge barrier analysis

New features for pathway identification and charge barrier analysis

Added method for performing Dijkstra-like pathway analysis on periodic graph.
Added the functionality to find a sequence of hops that take you from site-i to periodic image of site-i thus and identify intercalating pathways
Added functionality to assign a cost to individual migration events either using the integrated charge density along a tube or along s series of image sites determined by the PathFinder tool from pymatgen.

Hi @shyuep, apologies for how this large this PR is.  Much of this we kept in a private repo over last year for internal projects. Will it be possible to give me write access?

Hi @shyuep, apologies for how this large this PR is.  Much of this we kept in a private repo over last year for internal projects. Will it be possible to give me write access?

@shyuep  I think this is ready for merge now.

@shyuep  I think this is ready for merge now.

Thanks.

Thanks.


Output 0 of ViewBackward0 is a view

Hi,
I am trying to reproduce the experiment by finetuning a Llama2 model and I have the following error when doing the forward pass to get the embeddings:
"Output 0 of ViewBackward0 is a view and its base or another view of its base has been modified inplace. This view is the output of a function that returns multiple views. Such functions do not allow the output views to be modified inplace. You should replace the inplace operation by an out-of-place one."
Did you have the same error ? I think it is a problem with fsdp but I am using the same wrapping policy as you did

Usually, you would get that error if the embedding is not shared properly. You might want to add a print(model) to double check that the embedding is in fact wrapped individually as a "_fsdp_wrapped_module" object. The other thing you might want to check is the transformers version and the pytorch version. Pytorch constantly updates the FSDP.

Thank you ! You were right, the wrapping policy wasn't good. Now I am able to do the forward through the embedding but I have an error when I go through the whole model model(**batch):
Non-root FSDP instance's _is_rootshould not have been set yet or should have been set toFalse``
Have you ever seen this error ? I am using a more recent version of pyTorch for other reasons and was wondering if that might be the cause


Use xdg instead of directories-next; correct typo in directory name

This PR has two commits:

The first replaces directories-next with xdg. (The former seems to have an uncertain future.)
The second corrects a typo I made in #93.

EDIT: I could make these two PRs, or scrap either change, if you prefer.

The dependency change and typo fix look good. Why does this also rename a directory and update references to it?

I see. What is the typo fix? I cannot spot it in the diff.

Also, CI fails. Please run rustfmt to format the code. If that doesn't help please let me know - it's possible that CI version of rustfmt is too old.

I see. What is the typo fix? I cannot spot it in the diff.

Naming the directory dep_tests instead of deps_tests is what I am calling a "typo." The fix is to rename the directory to the latter. (Sorry for being unclear.)

Ah I see. Thanks! Merging.


Potential security issues in mimalloc-secure

Hi! @ironore15 and I are working for research on secure allocators.
During research, we have found several potential security issues in mimalloc-secure mode.
We want to get your feedback regarding these issue.s

Metadata leakage

We found that metadata can be leaked even in secure mode.
Here is the proof of concept code.
#include <stdio.h>
#include <stdlib.h>

int main(void) {
    void *p1 = malloc(32);  // prevent calling mi_segment_free
    void *p2 = malloc(64);  // page with xblock_size = 64
    free(p2);  // calling _mi_page_retire
    void *p3 = malloc(-8);  // trigger mi_heap_collect with MI_FORCE
    void *p4 = malloc(128);  // alloc page with same page_area
    fprintf(stderr, "%p\n", ((void **)p4)[8]);
}

If we run the code in Ubuntu 18.04, it shows like this.
$ LD_PRELOAD=./libmimalloc-secure.so ./test
0x41cb4a160092279d

As you can see, ((void **)p4)[8] contains encoded metadata of mimalloc heap.
We believe that it breaks your attempt to remove internal data in secure mode.
It happens because  _mi_page_free doesn't remove metadata of free_list. In the above PoC, when we call malloc(-8), which is huge page, mimalloc calls _mi_page_free to reclaim used pages. A page with xblock_size=64  from p2 is also one of reclaimed pages. Then, the next malloc(128) will reuse the previous page, which contains an encoded free_list.
I think one way to fix this issue is that we can zero-out page in secure mode.

Heap spray

In mimalloc-secure mode, an attacker can allocate a fixed memory address and bypass ASLR.
Here is PoC code.
#include <stdio.h>
#include <stdlib.h>
int main(void) {
    void *p = malloc(0x40000000000);
    *(int *)0x7FFFFFFF000 = 0;
    return 0;
}

This always exit successfully without segmentation fault.
It happens because eager commit option and mmap with aligned hint address. When segment is initially allocated, it calls _mi_mem_alloc_aligned. On UNIX system, it internally calls mi_unix_mmapx with addr is NULL, and mi_os_get_aligned_hint to get address for segment. In the following the code, (1 << 42) ~ (1 << 43) are only valid segment address. Since Eager commit is enabled default, very large allocation, e.g., malloc(1 << 42), will always alloc memory address between 0x7FFFFFFF000 ~ 0x80000000000.
We believe that one easy way to mitigate this is to disable eager commit in secure mode.
But I am not sure that it fits with mimalloc's design descision.
Best,
Insu Yun

Hi Insu & @ironore15 -- thank you for finding these issues! quite ingenious :-)
(as an aside, maybe research things like this work better as an email discussion at first? the issue even reads like an email to me :-) )

Yes, that is a metadata leak. Generally not good except this is the free-list metadata which is already considered compromised by mimalloc since it is interspersed among regular user allocated blocks. That is why mimalloc encodes the free list using the secret keys from the actual page metadata (which resides outside user data with a guard page in-between). Moreover, I am quite sure  that when you get a fresh page (the one that was just freed in your example) the keys are updated and thus the old linked-list metadata has no meaning anymore.
So, we (a) already consider linked list data compromised, and (b) the data from the POC is stale. Still, mimalloc tries to not make it easy to get to it, and in the POC it is very easy :-) I will first verify if the data is always stale (and if not, make sure we refresh the
keys in all cases) -- that seems to be enough though and cheaper than zeroing.

Ouch, also looks not good. However, it took me a while to understand what is going on and I am not sure how bad/real this is? As I understand it:  (a) mimalloc generates a random start address between 4TiB and 8Tib  (4<<40 and 8<<40) that is aligned to the segment size (in 1.7.0, 4 MiB (4<<20)).  then (b) the POC allocates 4TiB so the final segment size memory before 8TiB will always be part of what is allocated, and the area between (8TiB - 4MiB)  up to 8TiB points to valid memory. This allows the POC to allocate memory at a fixed address.
I do not yet understand what eager commit has to do with this -- I think this always happens?
Also, I am not sure how bad this is as the returned block address is still random; we can only predict it will cover a particular  range of addresses. Usually, ASLR prevents an attacker from knowing an address that was allocated by the system (say, virtual method tables) but in this case the attacker only knows that some part of a block that was allocated by the attacker themselves will be at a specific address.
and I don't think we can prevent this problem in general: the limit of virtual addresses in Linux now is 128TiB so if one allocates a block of about that size there is no way to return a randomized address. If one allocates a block of 64TiB than even randomizing the address over 64TiB would still leave some predictable memory just before 64TiB. Perhaps we need to limit the max allocation size? Or I guess start increasing the random address space beyond the first 4-8TiB for larger allocations. I need to think a bit more about this.

Best, Daan

Hi, Dann.
Thanks to your quick response.

Good. Let us know after you verify.

Sorry, I think its our fault.
I also agree that this issue is not relevant to eager commit.
It's because MAP_NORESERVE is always turned on in mimalloc.
I think one way to prevent this is that just turning off MAP_NORESERVE to disable overcommit.

I think this issue can have several potential security problems.
First, of all, using the allocation success as an oracle, an attacker can break ASLR.
For example, allocate a very large chunk and see if it is allocated.
Using this we can conclude where the hole exist, which gives us address information.
Here is more detailed explantation.
More generally, I believe that it weakens ASLR.
For example, this issue can make attack feasible even
though the exploit requires an address value,
which is prohibited in a normal ASLR setting.
Best,
Insu Yun

@insuyun @daanx - It might be best to take this offline through MSRC. Here is an example process for MSVC STL: https://github.com/microsoft/STL/blob/main/SECURITY.md

Thanks Insu -- and thanks for the link, looks like an interesting paper. I have  been wanting to do better ASLR anyways -- I feel just using a random base address may be too weak and it would be better to randomly spread out even more. Fixing this may be a good opportunity to revise this.

Thank you @bhardwajs and Dann.
Let me know after your discussion.
Best,
Insu Yun

Thanks for mentioning MSRC and providing a link Sumit. That is the proper channel to report severe issues (although it might still be better to contact me first over email).
I think in this particular case it seems ok to keep discussing here though as the current issue would be not easy to exploit. Also, often with security issues for allocators it is debatable whether the behavior is ok or not (see here for example).

Oh. I thought that you have an internal line for communicating with msrc. As Daan said, its not a big issue that msrc officially handles.
I totally agree with Daan that it is often debatable which behavior is fine in a secure allocator. That is one of our motivations for this research.
We have found several interesting behaviors in many allocators. But we selectively reported them if we believe that this can be really problematic
(e.g., https://github.com/SamAinsworth/MarkUs-sp2020/issues/3, https://github.com/bwickman97/ffmalloc/issues/1).
For example, we decided to report first issue(metadata) because we found your attempts to limit metadata leakage. So we conclude that it seems to violate your expectation.
We also reported the second one(spray) because it is an unique issue in mimalloc, which cannot be observanle in other secure allocators that we tested.

I pushed an initial fix for the second issue -- simply not using hinting for allocations over 1GiB to ensure enough randomness (and falling back to the OS for alignment for larger than 1GiB allocations).  Still investigating the first issue but it looks actually ok.


Intended behaviour of ReadSubtreeInt32 in ItemsUnpacker.Read.cs

In ReadSubtreeInt32 I'm slightly puzzled by the intent of the code.  If the value that has been read by:
var type = this.ReadValue( out header, out integral, out real32, out real64 );
is actually a double, the result will be in real64 (or real32 for a float).  Then later in the switch statement we get to the ReadValueResult.Double case.  That casts the value in the integral variable to an Int32 and returns it in the result out param and returns true.  However integral will always be zero in that case.  I would expect the code to either return false (ie the read failed) or round/truncate real64 to an Int32 if returning true.
Am I missing something about the intent of the code here?

No, you are right. It is a bug of T4 code.

Close because no additional post about 3 months after fixed.


feat(c/driver/postgresql): Interval support

alternate to #907 still needs some work to get the test templates working

Yeah, we can ignore that for now


Reference integration for FPGA

Goal: Provide a minimal, but fully working example of how to use Ibex on a well-known FPGA board.
Target board: One of the well-known Xilinx 7-series boards, Nexys or Arty*.
This will require:

A toplevel
Additional hardware blocks

A RAM
A prim_clock_gating implementation
A trivial GPIO IP would be nice which maps some bus reads/writes to LEDs/Switches.

A board-dependent constraints file (xdc)
Build system support (a fusesoc core file)
Documentation and code to run a minimal hello world (including linker file, crt)

I'm not sure about where to put these things into the repository, I'd most likely go for a top-level directory like examples/fpga/nexyvideo and examples/sw/hello_world.

Talk to me when you're getting started on this issue, I have some existing code to share that we can reuse.

Implemented with PR https://github.com/lowRISC/ibex/pull/78


no batch support

for gentoo raw types xpak or bz2    adding *.foo   *.bar , is a no go...   anycase raw dir tree sync isnt in yet..  as you can have gcc-6.x and cross-gcc/gcc-6.x or etc..  however in repo... on cloudsmith as a flat
the files will collide...   hopefully soon fixed..
cloudsmith push raw --tree=/usr/portage/packages/*  --batch .tbz2 ,.xapk
for sabayon Linux mainly *.bz2 and repo gpg and entropy db files made of gentoo packages..  in sqlite and metadata...  and class dev-util:name-mtimehash-numbers.tbz2
cloudsmith push raw --batch *.tbz2
building file list  ,  loop n cloudsmith push raw reponame $package$name/s
likewise for publishers , *.rpm deb etc..
Got unexpected extra arguments (f2c-20100827.tbz2 go-1.10.1-1.xpak go-1.8.1.tbz2 go-1.9.1-1.xpak lua-5.1.5-r4.tbz2 perl-5.24.1-r2.tbz2 perl-5.24.3.tbz2 perl-5.26.1.tbz2 perl-5.26.1.tbz2.1 python-2.7.12.tbz2 python-3.4.6.tbz2 python-3.5.3.tbz2 python-3.5.3.tbz2.27064 python-3.5.4.tbz2 python-3.6.1-r1.tbz2 python-3.6.3.tbz2 python-exec-2.4.5.tbz2 ruby-2.1.9.tbz2 ruby-2.2.7-r2.tbz2 ruby-2.2.8-1.xpak tcl-8.5.17.tbz2 tcl-8.6.6.tbz2 tcl-8.6.7.tbz2 tk-8.6.7.tbz2 vala-0.34.3.tbz2 vala-0.36.5.tbz2 yasm-1.3.0.tbz2)
ps...
https://cloudsmith.io/package/ns/necrose99/repos/cloudsmith-arm64-eggs/packages/
{gentoo will typically gripe ver eggs or prebuilt  via pip install as it expects virtual en or user
,  however suitable for any distro....
mainly since gentoo can swap python defaults on the fly
and for the time being i don't care to rebuild for iot-arm64... atm.  if the box crashes.. }
however do enjoy...

I want to share the trick to upload multiple files at once, without the shell script with for loop.
The trick is to use fd-find tool.
Given that I save all the *.whl files (for Python) in current folder, I run this command to upload all those to my CloudSmith repo:
fd whl --exec cloudsmith push python agriconnect/python-musl {}

You can also do the same with find command, using --exec switch, but the find syntax is far longer.

Awesome tip @hongquan - We will have to borrow this for the official docs (with credit). :)


Support for spaces on daily note filename

Was about to open a PR but only noticed after cloning the repo that all the code is inside the bundle file. What's the best way to contibute then?
The issue I'm having is the workflow producing the wrong Obsidian URI when the Daily note file has a space on the filename.
Calling od, with the daily note format YYYY-MM-DD dddd, the space needs to be encoded in the URI as well.
The fix is simple:

Line 256:
p = encodeURIComponent(v) + "&file=" + date_format + ".md";
uri = "obsidian://open?vault=" + p;

to
p = encodeURIComponent(v) + "&file=" + encodeURIComponent(date_format) + ".md";
uri = "obsidian://open?vault=" + p;

Regards

Thanks for catching that! Yea, it's not easy to contribute to Alfred workflows. Here's the easiest way to contribute, I think.
Edit the relevant lines of code in info.plist. I think the lines are 1093, 1103, 1428, and 1438. Then test the new workflow. First convert the new info.plist to a zip file (info.plist.zip). Then rename it to info.alfredworkflow. Double-click it and Alfred should ask whether to install the workflow. If it works, contribute and submit a PR!
Alternatively, you can modify those four lines directly in the Alfred workflow (but the line numbers will be different than in the .plist file). Then, export the workflow to Obsidan.alfredworkflow. Rename it to Obsidian.zip and unzip it and you'll get the updatedinfo.plist. I'd recommend the method above instead of this one though.


Create release checklist

Closes https://github.com/sensu/sensu/issues/1702

LGTM, lets commit to revisiting this next time we cut a release so we can fill in any gaps.


GL Error code is not 0, after calling regl constructor

If I run the test test/stats-gputime.js in the browser, then this test here:
https://github.com/mikolalysenko/regl/blob/gh-pages/test/stats-gputime.js#L14
fails. It says that gl.getError() returns 1282. But it should return 0.

Seems to have been fixed by #192


WIP: collect without inference

Collect an iterable of Tuples or NamedTuples to a Columns object, without using inference. The Columns object is initialized with the type of the first element and progressively widened, should this type change.
I assume that the iterator iterates Tuples (or NamedTuples) always of the same length and, in the NamedTuples case, always with the same fieldnames.
The condition to trigger widening is that at least one field of the iterate tuple is not a subtype of the eltype of the corresponding  column.
Widening happens element-wise, meaning I perform typejoin on a field by field basis.
To work with missing in the future typejoin is not the correct operation, as:
julia> typejoin(Missing, Int)
Any

but Base.promote_typejoin should be sufficient to fix this.
The overall strategy is more or less a copy-paste of Base Julia strategy to collect generators of unknown type.

Concerning missingness, I see the concern. One optimization I can do is to not copy the whole thing, but also figure out what is the "offending column" and only copy that one (there is a setcol function to only change one column without copying the rest: it should be pretty efficient). Like this each column is copied at most once. Of course, if there was a way to widen a vector to a vector that allows missing, this would be even better: is there any progress on that front?

Concerning missingness, I see the concern. One optimization I can do is to not copy the whole thing, but also figure out what is the "offending column" and only copy that one (there is a setcol function to only change one column without copying the rest: it should be pretty efficient). Like this each column is copied at most once.

Good trick!

Of course, if there was a way to widen a vector to a vector that allows missing without copying, this would be even better: is there progress on that front?

I don't think there's been any progress (the priority is merging breaking changes for 1.0).

I'm starting to think that using the trick of "columnar storage" the situation is not nearly as bad as with a vector of NamedTuples, if copying each column at most once is considered acceptable, we may be able to skip inference altogether (plus, with your promote_typejoin PR, we wouldn't really need to special case the code so much to accomodate Missing).

Yeah, it should be more reasonable, at least if we are able to make convert non-copying. That's an interesting approach to test.

Benchmarks are very encouraging, for some reason this is actually faster than our current implementation in the type stable case....
julia> using IndexedTables, BenchmarkTools

julia> s = table(rand(1000), rand(1000), names = [:x, :y]);

julia> f(i) = @NT(sum = i.x + i.y, diff = i.x - i.y)
f (generic function with 1 method)

julia> map1(f, s) = table(collectcolumns(f(i) for i in s), copy = false, presorted = true)
map1 (generic function with 1 method)

julia> @benchmark map($f, $s)
BenchmarkTools.Trial:
  memory estimate:  105.02 KiB
  allocs estimate:  2554
  --------------
  minimum time:     64.973 μs (0.00% GC)
  median time:      72.453 μs (0.00% GC)
  mean time:        83.847 μs (7.97% GC)
  maximum time:     2.059 ms (91.21% GC)
  --------------
  samples:          10000
  evals/sample:     1

julia> @benchmark map1($f, $s)
BenchmarkTools.Trial:
  memory estimate:  17.83 KiB
  allocs estimate:  44
  --------------
  minimum time:     13.858 μs (0.00% GC)
  median time:      15.307 μs (0.00% GC)
  mean time:        17.561 μs (4.52% GC)
  maximum time:     1.198 ms (91.14% GC)
  --------------
  samples:          10000
  evals/sample:     1

julia> map1(f, s) == map(f,s)
true

I still need to:

[ ] Implement the unknown length iterator case

[ ] Generalize to work with scalars and just collect an Array

[ ] Decide on a name for collectcolumns (though maybe collectcolumns is not so bad)

And then we could start porting things to use this instead of inference.

That's pretty awesome! The patch looks good to me!! :-)
Now the challenge is figuring out how to implement groupreduce and groupby as iterators
Then there is the elephant in the room --- join :-)

but Base.promote_typejoin should be sufficient to fix this.

I like the sound of that!

Oops I think the current implementation of map allocates, probably because of https://github.com/JuliaLang/julia/issues/15276 since we close over fs?

If I just call f instead of fs (which understandably isn't inferable), the performance is 20% slower in the relevant portions (allocation + filling), but I think we can take that for the benefits and simplicity this PR affords.

I see, I couldn't really understand how this PR could be faster. 20% sounds fair: the last step of converting to a table could account for that. map2(f,s) = collectcolumns(f(i) for i in s) is much faster than map1, not sure why, I thought converting to table was for free.
In terms of groupby and groupreduce, I made the SizeUnknown implementation for them, after we merge this one I can see how to translate them to use it (groupreduce is already doing with this PR strategy but assuming concrete grouping). For join we should actually change typejoin.
We should (before 0.7, then there is @nalimilan's PR to rescue us) define our own promote_typejoin and add promote_typejoin(::Type{<:DataValue}, ::Type{T}) = DataValue{T} and then it should work out of the box (though we may also need to tweak the s <: t part to allow Float64 <: DataValue{Float64} - of course using our own version of <:). Better leave it for last though.
A possible strategy could be, in the following order:

Decide on a name for collectcolumns and merge this PR (could also leave collectcolumns)
port map, which should be trivial
port groupby and groupreduce which could be a bit trickier
think about join and revisit this PR to adjust as needed.

The tricky thing about group is that it also uses inference to decide whether to wrap f in a function or not, so maybe that's not so easy.

I thought converting to table was for free.

That is suspicious actually, it's the simplest wrapper when copy=false, presorted=true... Worth profiling.

I was not timing the table creation, and that could have been the 20% overhead... I did some profiling, it looks like it's just the overhead of dispatch calling many methods with keyword arguments.

define our own promote_typejoin and add promote_typejoin(::Type{<:DataValue}, ::Type{T}) = DataValue{T}

julia> promote_type(DataValue{Int}, Float64)
DataValues.DataValue{Float64}

why not use promote_type?
I think the 4-step plan sounds perfect. collectcolumns seems like a good name. Maybe collect_columns is easier to read, and mirrors the use of _ after collect in Base.
Cheers!

promote_type is actually an interesting idea, I think I'll switch to that. I like it because it will give a tighter type than typejoin, then I guess we'll have to see in practice if that's enough to get join to work out of the box. I'll switch to that (and to collect_columns - I also think it reads better) + docstrings and I think it's good to go.

One potential issue with promote_type is that promote_type(Int, Float64) === Float64, which means that big integers would be silently rounded. OTOH that's what happens with cat on arrays already, so...

I saw that but I think it's better than returning an Array{Real}, especially if there are precedents like vcat. The use case of mixing up large Int64 and Float64 while wanting to preserve the Int64 exactly (where they are already at a size that risks overflow) seems limited.

There's a _promote_type in JuliaDB.jl which does promote_type on all the fields of a tuple (using map_params). Maybe we should move that here and reuse it there. It's a minor detail that will need an in-tandem release. Everything looks good here: feel free to hit merge!

One thing though: throughout the code, I'm assuming that the number of fields in the output Tup is constant throughout the data, but one of the tests has map of a function which does not respect this property. The old code would give an Array of Tuples (as it is a case where inference failed). Should we just error in that case?

Why can't we switch to Array{Tuple} in this case?

It's actually not so trivial though, as the Array{NamedTuple}  can get horribly inefficient (in the future Missing world), as separate fields can go missing in different moments and every time we'd need to copy everything (as the trick I'm doing here of only changing the relevant columns doesn't work). Not sure what's the best course of action: unless there are clear usecases it may be better to error.

If the user insists of having tuples of different lengths, he/she can always wrap them in a one-element Tuple.

and every time we'd need to copy everything

Why? Array{NamedTuple} should be wide enough for any tuple, even those containing missing?

Ah, fair enough, as soon as different length are encountered it will just give a NamedTuple. without specializing further. I'll see if there's a way to include this without making the code too ugly...
OTOH, don't you think it'd be better to error and propose that the user has to be explicit if he/she wants this funny Array of tuples of different length? collect_columns((ntuple(identity, i),) for i in 1:3)  for example.

You should be able to get rid of copying entirely if you widen to DataValueArray instead of Array{DataValue} (or are you doing that already? From a quick glance at the code I got the impression that you don't). In that case you can just reuse the array with the values that you collected so far, stuff it into a new DataValueArray and the only significant new allocation in a widening operation would be the missing mask (which of course is not a problem because it would have been allocated at some point in any case).
On the flip side, probably not even needed, because with DataValue you probably will pick the right column type right away based on the first element in the iteration in any case.

Thanks for the tip! It will probably be needed for join as there one could get DataValue because the row is missing even when the field is of type Int for example. I'll probably have to revisit this for join and will include your trick!

We do the trick for DataValueArrays in TextParse. At some point (maybe with Parsing.jl) we should use this type of iterator approach there as well. The promotion rules there are quite complex (e.g. string columns are started off as PooledArray, then the pool is widened, if there are a large number of uniques, we switch to Array{String})


Allure plugin does not build the 3rd level

What are you trying to achieve?
I call a custom steps function from a page object function. The custom steps functions contains a set of I.do directives itself. I want nesting of steps of the test be correct in the resulted Allure report like presented beneath.
IdoActionFromTestFile
pageObject.method
  actionFromPageObjectMethod
  steps_file.method_calledFormPageObjectMethod
    IdoActionFromStepsFileMethod1
    IdoActionFromStepsFileMethod2

What do you get instead?
An incorrect nesting. While the custom steps function is called from the page object function, it gets displayed in the Allure report as if it had been called from the body of the test.
IdoActionFromTestFile
pageObject.method
  actionFromPageObjectMethod
steps_file.method_calledFormPageObjectMethod
  IdoActionFromStepsFileMethod1
  IdoActionFromStepsFileMethod2

Tried to debug a little. It showed that MetaStep of the custom steps function step is blank, whereas it should refer to the page object function.
Details

CodeceptJS version: 2.6.11 and 3.0.0-beta.4
NodeJS Version: 13.11.0
webdriverio

I can see a similar issue was logged https://github.com/codeceptjs/CodeceptJS/issues/3131


Add SQLite storage

closes #18

Pull Request Test Coverage Report for Build 109420355

1 of 5 (20.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.04%) to 53.555%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

platform/discord/bot.go
1
3
33.33%

platform/discord/messagefunctions.go
0
2
0.0%

Totals

Change from base Build 107349843:
-0.04%

Covered Lines:
1273

Relevant Lines:
2377

💛  - Coveralls


Implement possibility for vector-valued parameters

Currently, all parameters are scalars. But there was some requests to also allow for vector valued parameters. To do so, one would probably have to add a new parameter-property 'length', and implement some additional changes.

I think this is a must have if you want to have a reasonable runtime for larger problems.

I think there is a misunderstanding. Vector valued parameters that Alex meant above relates to defining a parameter as a model parameter that is a vector (for a single model), e.g. if you want to identify a random field, those parameters of the random field (or the principal components). I think what @rozsasarpi means is the parallel evaluation of multiple forward models/likelihood in parallel, which could be implemented by passing a list of parameter dict and similarly returning a list of sensor outputs.


401 Client Error in loading Llama2-7b model

Hi,
I tried to run the main.py and I got following error messages.
It looks like it failed to load the Llama2-7b model.
Any help will be appreciated.
$ python main.py 'How much is the minimum guarantee payable by adidas?'
==
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py", line 261, in hf_raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.10/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/models/models/llama-2-7b-chat.ggmlv3.q8_0.bin/revision/main
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/workspace/test/Llama-2-Open-Source-LLM-CPU-Inference/main.py", line 26, in
dbqa = setup_dbqa()
File "/workspace/test/Llama-2-Open-Source-LLM-CPU-Inference/src/utils.py", line 44, in setup_dbqa
llm = build_llm()
File "/workspace/test/Llama-2-Open-Source-LLM-CPU-Inference/src/llm.py", line 21, in build_llm
llm = CTransformers(model=cfg.MODEL_BIN_PATH,
File "/usr/local/lib/python3.10/dist-packages/langchain/load/serializable.py", line 74, in init
super().init(**kwargs)
File "pydantic/main.py", line 339, in pydantic.main.BaseModel.init
File "pydantic/main.py", line 1102, in pydantic.main.validate_model
File "/usr/local/lib/python3.10/dist-packages/langchain/llms/ctransformers.py", line 70, in validate_environment
values["client"] = AutoModelForCausalLM.from_pretrained(
File "/usr/local/lib/python3.10/dist-packages/ctransformers/hub.py", line 130, in from_pretrained
config = config or AutoConfig.from_pretrained(
File "/usr/local/lib/python3.10/dist-packages/ctransformers/hub.py", line 47, in from_pretrained
cls._update_from_repo(
File "/usr/local/lib/python3.10/dist-packages/ctransformers/hub.py", line 69, in _update_from_repo
path = snapshot_download(
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/_snapshot_download.py", line 186, in snapshot_download
repo_info = api.repo_info(repo_id=repo_id, repo_type=repo_type, revision=revision, token=token)
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/hf_api.py", line 1868, in repo_info
return method(
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/hf_api.py", line 1678, in model_info
hf_raise_for_status(r)
File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py", line 293, in hf_raise_for_status
raise RepositoryNotFoundError(message, response) from e
huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-64b9e8a9-40a275255e2a52783534bb88;5565df67-c3e7-4849-ad18-f760c8a653fa)
Repository Not Found for url: https://huggingface.co/api/models/models/llama-2-7b-chat.ggmlv3.q8_0.bin/revision/main.
Please make sure you specified the correct repo_id and repo_type.
If you are trying to access a private or gated repo, make sure you are authenticated.
Invalid username or password.

Oh, I should download the model to local first. The problem solved.

Hi Wenny, glad that it is solved. I will update the README as well to relay this point


Test must be added for maxLength in the cache

For this code fix: https://github.com/tildeio/htmlbars/pull/365 which caused failures in Ember but not here.

/cc @jayphelps

this code path has changed, I don't think its needed any longer.


Add a script to run tests locally

Here is a script that makes running tests locally easier.
Before you had to follow the doc. Now you just run ./scripts/run-test.sh join-organization. This was helpful to me when I wanted to run local tests on a11y.
Questions:

maybe the doc about running test could be removed and we could tell people to just rely on the script?
I'm still inclined to install cypress-related dependencies as project dependencies instead of global dependencies, but I left the logic as is in this PR.

I now realize the idea was to prevent installing the big cypress binary unnecessary.

I can add axe-core and cypress-axe-core as devDependencies, just noticed you already did that with cypress-mailslurp
for cypress, I like the optionalDependencies idea. Or note we can also use an env var to skip cypress binary install: https://docs.cypress.io/guides/references/advanced-installation#Skipping-installation. Either way requires a change on how we install dependencies when deploying I guess.

So here is a suggestion to handle cypress dependency, see latest commit:

The idea is to include cypress dependency inside the project instead of
relying on global installs here and there.

use cypress as dev dependency
make sure necessary dependencies are installed on each CI workflow:

on e2e tests we want to install everything, cypress binary
included
on fixtures tests we don't need any dev dependency, no need to
include them
on test tests we need prettier, so we include dev dependencies,
but we dont want cypress binary: use the cypress related env var to
prevent binary installation

scalingo will need to have NPM_CONFIG_PRODUCTION=true setup to prevent
installing dev dependencies

I deployed a review app on scalingo to test this, having NPM_CONFIG_PRODUCTION=true set in scalingo env vars. With success!


Add warning about logged tokens to the README

Rails now defaults to config.log_level = :debug in production. Since the entire contents of outgoing emails are logged at the debug level, this means plaintext password reset tokens are exposed in log files. Active Job also logs all arguments to enqueued jobs at the info level, so deliver_later will leak tokens as well, even if the log level is set to :info.
I suggest updating the Devise README to make developers aware of the issue.

:heart: :green_heart: :blue_heart: :yellow_heart: :purple_heart:


Update PANDA values for nublado/idfint

Agreed, but I also wanted all the PANDAs config alphabetically sorted and together, which is why I moved IDDS_CONFIG.  Canonicalizing quotation of values in this section was mostly just to satisfy my OCD.


Implement messages to celebrate successful PR contributions

Provide congratulatory messages when a new contributor submits their first and second PRs or more.
The Solution:-
We will add a GitHub Action that will trigger when a PR gets merged into the main branch.
I would love to implement it.

@Mayank77maruti  Good idea, lets do it!
@TaliCohn @Nadav138 @EdenSchirmanClassiq FYI

@Mayank77maruti - assigned you to it together with @Nadav138


breaking change in release 2.1.2

change that invalidates cache based on the original stack is breaking and should've been a major increment. I'm specifically relying on this behaviour to pass artifacts between 2 different stacks as I'm unable to run docker in docker on os x stack and has to initially trigger a build on linux stack and then hand off the job to os x.
please provide an opt out of new behaviour of republish this as 3.x, while you may see this is a bug - this was a pretty useful feature :)

Hi @AVVS!
Sorry for the delay in addressing your inquiry. Would you consider creating a feature request  about this? 🙂


🎆 Happy New Year 2025 - Update maintenance & license

Proposed Changes

(Describe the changes and rationale behind them)

Related Issues

(Github link to related issues or pull requests)

@coderabbitai review


Performance Issue

I just want to the the tps of gateway, the gateway simple route the request to a nginx index.html. In my mbp, the nginx raw performance is 10k, but it downgrade to about 300tps when running with this gateway. From the jstack log, it seems the thread are all blocked by the log.
Please check the log here
"reactor-http-nio-4" #16 daemon prio=5 os_prio=31 tid=0x00007fcfd27f7800 nid=0x540b waiting for monitor entry [0x0000700001452000]
java.lang.Thread.State: BLOCKED (on object monitor)
at ch.qos.logback.classic.LoggerContext.getLogger(LoggerContext.java:151)
- waiting to lock <0x0000000740bc52c8> (a ch.qos.logback.classic.Logger)
at ch.qos.logback.classic.LoggerContext.getLogger(LoggerContext.java:53)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358)
at reactor.util.Loggers$Slf4JLoggerFactory.getLogger(Loggers.java:78)
at reactor.util.Loggers.getLogger(Loggers.java:55)
at reactor.core.publisher.SignalLogger$$Lambda$304/463255032.apply(Unknown Source)
at reactor.core.publisher.SignalLogger.(SignalLogger.java:119)
at reactor.core.publisher.SignalLogger.(SignalLogger.java:75)
at reactor.core.publisher.Mono.log(Mono.java:2202)
at reactor.core.publisher.Mono.log(Mono.java:2171)
at reactor.core.publisher.Mono.log(Mono.java:2129)
at org.springframework.cloud.gateway.handler.RoutePredicateHandlerMapping.getHandlerInternal(RoutePredicateHandlerMapping.java:53)
Test report with jmeter
Starting the test @ Tue Oct 31 11:42:20 CST 2017<PHONE_NUMBER>379)
Waiting for possible Shutdown/StopTestNow/Heapdump message on port 4445
summary +   1678 in 00:00:09 =  182.9/s Avg:   481 Min:     7 Max:  2151 Err:     0 (0.00%) Active: 100 Started: 100 Finished: 0
summary +   7050 in 00:00:30 =  235.1/s Avg:   298 Min:     6 Max:  2505 Err:     0 (0.00%) Active: 100 Started: 100 Finished: 0
summary =   8728 in 00:00:39 =  222.9/s Avg:   333 Min:     6 Max:  2505 Err:     0 (0.00%)
summary +   7429 in 00:00:30 =  247.6/s Avg:   129 Min:     6 Max:   610 Err:     0 (0.00%) Active: 100 Started: 100 Finished: 0
summary =  16157 in 00:01:09 =  233.6/s Avg:   240 Min:     6 Max:  2505 Err:     0 (0.00%)
summary +   5778 in 00:00:30 =  192.5/s Avg:    62 Min:     7 Max:  1366 Err:     0 (0.00%) Active: 100 Started: 100 Finished: 0
summary =  21935 in 00:01:39 =  221.2/s Avg:   193 Min:     6 Max:  2505 Err:     0 (0.00%)
summary +   5833 in 00:00:30 =  194.5/s Avg:    26 Min:     4 Max:   177 Err:     0 (0.00%) Active: 100 Started: 100 Finished: 0

Configuring logback to use async logging should help there https://logback.qos.ch/manual/appenders.html#AsyncAppender
For now, I will remove the .log() calls.

Closed via 64cf267

@spencergibb
I think using the async cannot solve this problem, as I have config loging.level.root=warn for better performance before testing.


pkgcheck container

So at the moment I am using a certain version of my container, which of course uses a set version of your container and thus {pkgcheck} @mpadge
I am wondering if this makes sense... pre-cran it would make sense to always use latest version of everything but post-cran it would make sense to stick to fixed versions, right? Or should we always use the latest container? Alternatively I can add an input so we can choose?

The rOpenSci workflow for which this has all been developed definitely needs continuously updated containers. The main pkgcheck contain is cron'ed to rebuild weekly, with the entire server on which it depends also rebuilding itself weekly. I can't see any real need to use a fixed version, because as said elsewhere, this will all remain very actively maintained software for as long as it is being used as part of the software review process, which means indefinitely.

You are right the usual considerations for reproducibility don't make sense in this use case.
By the way it is possible to trigger the docker build in this repository from the pkgcheck repository, so we could keep this container up-to-date 1:1 with the base container!

Rolling release it is. And ropensci-review-tools/pkgcheck/pull/121 has the workflow_dispatch trigger.


X910 dependency update

Dependency updates on SPrint client

When I try to run yarn, I get
error<EMAIL_ADDRESS>The engine "node" is incompatible with this module. Expected version ">=12.13.0 <17.0". Got "18.7.0"
error Found incompatible module.
Do you know how to address this? Do I need to run an earlier version of node?

When I try to run yarn, I get error<EMAIL_ADDRESS>The engine "node" is incompatible with this module. Expected version ">=12.13.0 <17.0". Got "18.7.0" error Found incompatible module.
Do you know how to address this? Do I need to run an earlier version of node?

The previous git node version was 14.19.3
But, now it is changed to 18.7 and it seems to be working in mine. Would you please try a 'yarn install'?

I have made a PR with a change in workflow to get the node version from .nvmrc file. Would you please try whether that helps?

A change in the .github/workflow will not affect what happens when I try to run the client locally.

A change in the .github/workflow will not affect what happens when I try to run the client locally.
@apollo/federation package has not been explicitly included in package.json. But when I checked

the documentation it says, the package supports only Node 14 or Node 16.

But I don't understand why it is not giving an error in mine. I am running SPrint server using docker image and I can see it is up and running

Would you please change the node version and see whether that helps to Node 14.x

Would you please change the node version and see whether that helps to Node 14.x? Also, can you try removing all node_modules by rm -r node_modules/ and then yarn install

I don't have any node_modules directory. Perhaps you can show me tomorrow how to run it with the correct node version.

Would you please change the node version and see whether that helps to Node 14.x? Also, can you try removing all node_modules by rm -r node_modules/ and then yarn install

I don't have any node_modules directory. Perhaps you can show me tomorrow how to run it with the correct node version.

Sure, we can do that tomorrow.

I used yarn install --ignore-engines to avoid the errors.


returning empty data

https://github.com/firebase/quickstart-android/blob/1791a58ffe13f364dfc1b39356ca0ec8fbf0d7f5/config/app/src/main/java/com/google/samples/quickstart/config/MainActivity.java#L136

@ravichandra8 there is not enough information here to help you debug, please file a new issue and fill out the entire template if you still need help.


[urgent] VMware ESXi 6.7, Patch Release ESXi670-202403001

https://docs.vmware.com/en/VMware-vSphere/6.7/rn/esxi670-202403001.html
if you want it I can upload it

Please send me a link and I will look into the possibility of of including this


test: change in stripe

Codecov Report

Merging #3 (68a1fc8) into main (b34813e) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #3   +/-   ##
=======================================
  Coverage   94.75%   94.75%
=======================================
  Files          48       48
  Lines        6907     6907
  Branches      445      445
=======================================
  Hits         6545     6545
  Misses        362      362

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


updated rollup and stories

Codecov Report

Merging #119 (3998882) into master (d338958) will increase coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #119      +/-   ##
==========================================
+ Coverage   78.82%   78.84%   +0.01%
==========================================
  Files         120      120
  Lines       11137    11137
  Branches     1191     1192       +1
==========================================
+ Hits         8779     8781       +2
+ Misses       2358     2356       -2

Flag
Coverage Δ

unittests
78.84% <ø> (+0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...onents/global-notification/global-notification.tsx
100.00% <0.00%> (+2.22%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d338958...3998882. Read the comment docs.


Database migration in credhub-release 2.12.94 fails.

What version of the credhub server you are using?
We are trying to upgrade to credhub-release 2.12.94 with MySQL as database.
What version of the credhub cli you are using?
Not relevant, server-side problem.
If you were attempting to accomplish a task, what was it you were attempting to do?
Upgrade cf-deployment from v44.6.0 to v44.7.0. The credhub-release version is upgraded from 2.12.93 to 2.12.94.
What did you expect to happen?
Upgrade of credhub server succeeds.
What was the actual behavior?
Upgrade failed because of a flyway migration error. Output from credhub.log is:
2024-11-08T19:26:29.643Z [main] ....  INFO --- BaseDatabaseType: Database: jdbc:mariadb://sql-db.service.cf.internal:3306/credhub (MySQL 8.0)
2024-11-08T19:26:30.014Z [main] ....  WARN --- FlywayMigrationStrategyConfiguration: Validation failed: "Validate failed: Migrations have failed validation
Migration checksum mismatch for migration version 58
-> Applied to database : -1214956128
-> Resolved locally    :<PHONE_NUMBER>. Either revert the changes to the migration, or run repair to update the schema history.
Detected resolved migration not applied to database: 57. To ignore this migration, set -ignoreIgnoredMigrations=true. To allow executing this migration, set -outOfOrder=true.
Need more flexibility with validation rules? Learn more: https://rd.gt/3AbJUZE".
2024-11-08T19:26:30.014Z [main] ....  INFO --- FlywayMigrationStrategyConfiguration: Attempting to repair...
2024-11-08T19:26:30.052Z [main] ....  INFO --- VersionPrinter: Flyway Community Edition 7.15.0 by Redgate
2024-11-08T19:26:30.109Z [main] ....  INFO --- JdbcTableSchemaHistory: Repair of failed migration in Schema History table `credhub`.`flyway_schema_history` not necessary. No failed migration detected.
2024-11-08T19:26:30.154Z [main] ....  INFO --- JdbcTableSchemaHistory: Repairing Schema History table for version 58 (Description: index lowercase credential name, Type: SQL, Checksum:<PHONE_NUMBER>)  ...
2024-11-08T19:26:30.159Z [main] ....  INFO --- JdbcTableSchemaHistory: Repairing Schema History table for version 58 (Description: index lowercase credential name, Type: SQL, Checksum:<PHONE_NUMBER>)  ...
2024-11-08T19:26:30.171Z [main] ....  INFO --- DbRepair: Successfully repaired schema history table `credhub`.`flyway_schema_history` (execution time 00:00.086s).
2024-11-08T19:26:30.192Z [main] ....  INFO --- FlywayMigrationStrategyConfiguration: Repair succeeded.
2024-11-08T19:26:30.193Z [main] ....  INFO --- FlywayMigrationStrategyConfiguration: Running FlyWay migration....
2024-11-08T19:26:30.214Z [main] ....  INFO --- VersionPrinter: Flyway Community Edition 7.15.0 by Redgate
2024-11-08T19:26:30.331Z [main] .... FATAL --- FlywayMigrationStrategyConfiguration: FlyWay migration failed. Crashing.
2024-11-08T19:26:30.333Z [main] ....  WARN --- AnnotationConfigServletWebServerApplicationContext: Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flywayInitializer' defined in class path resource [org/springframework/boot/autoconfigure/flyway/FlywayAutoConfiguration$FlywayConfiguration.class]: Invocation of init method failed; nested exception is org.flywaydb.core.api.exception.FlywayValidateException: Validate failed: Migrations have failed validation
Detected resolved migration not applied to database: 57. To ignore this migration, set -ignoreIgnoredMigrations=true. To allow executing this migration, set -outOfOrder=true.
Need more flexibility with validation rules? Learn more: https://rd.gt/3AbJUZE
2024-11-08T19:26:30.334Z [main] ....  INFO --- HikariDataSource: HikariPool-1 - Shutdown initiated...
2024-11-08T19:26:30.360Z [main] ....  INFO --- HikariDataSource: HikariPool-1 - Shutdown completed.
2024-11-08T19:26:30.369Z [main] ....  INFO --- StandardService: Stopping service [Tomcat]
2024-11-08T19:26:30.403Z [main] ....  INFO --- ConditionEvaluationReportLoggingListener:

Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2024-11-08T19:26:30.451Z [main] .... ERROR --- SpringApplication: Application run failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flywayInitializer' defined in class path resource [org/springframework/boot/autoconfigure/flyway/FlywayAutoConfiguration$FlywayConfiguration.class]: Invocation of init method failed; nested exception is org.flywaydb.core.api.exception.FlywayValidateException: Validate failed: Migrations have failed validation
Detected resolved migration not applied to database: 57. To ignore this migration, set -ignoreIgnoredMigrations=true. To allow executing this migration, set -outOfOrder=true.
Need more flexibility with validation rules? Learn more: https://rd.gt/3AbJUZE
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1804) ~[spring-beans-5.3.39.jar!/:5.3.39]
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:620) ~[spring-beans-5.3.39.jar!/:5.3.39]

Last entries in flyway_schema_history table:
+----------------+---------+-------------------------------------------------------------------------------+--------+----------------------------------------------------------------------------------------+-------------+--------------+---------------------+----------------+---------+
| installed_rank | version | description                                                                   | type   | script                                                                                | checksum    | installed_by | installed_on        | execution_time | success |
+----------------+---------+-------------------------------------------------------------------------------+--------+----------------------------------------------------------------------------------------+-------------+--------------+---------------------+----------------+---------+
(...)
|             72 | 56      | change expiry date in certificate credential                                  | SQL    | V56__change_expiry_date_in_certificate_credential.sql                                  |  -969791477 | credhub      | 2024-03-27 12:31:05 |             59 |       1 |
|             73 | 57.2    | delete related encrypted value when credential is deleted                     | SQL    | V57_2__delete_related_encrypted_value_when_credential_is_deleted.sql                   | -1930144391 | credhub      | 2024-03-27 12:31:05 |             97 |       1 |
|             74 | 57.2    | delete related encrypted value when credential is deleted                     | DELETE | V57_2__delete_related_encrypted_value_when_credential_is_deleted.sql                   | -1930144391 | credhub      | 2024-04-16 08:18:47 |              0 |       1 |
|             75 | 58      | index lowercase credential name                                               | SQL    | V58__remove_triggers.sql                                                               |<PHONE_NUMBER> | credhub      | 2024-04-16 08:18:48 |             83 |       1 |
|             76 | 58      | remove triggers                                                               | DELETE | V58__remove_triggers.sql                                                               | -1214956128 | credhub      | 2024-04-16 09:23:41 |              0 |       1 |
|             77 | 57.2    | delete related encrypted value when credential is deleted                     | SQL    | V57_2__delete_related_encrypted_value_when_credential_is_deleted.sql                   | -1930144391 | credhub      | 2024-04-16 09:23:41 |            105 |       1 |
|             78 | 57.2    | delete related encrypted value when credential is deleted                     | DELETE | V57_2__delete_related_encrypted_value_when_credential_is_deleted.sql                   | -1930144391 | credhub      | 2024-04-16 10:16:39 |              0 |       1 |
|             79 | 58      | index lowercase credential name                                               | SQL    | V58__remove_triggers.sql                                                               |<PHONE_NUMBER> | credhub      | 2024-04-16 10:16:40 |             82 |       1 |
+----------------+---------+-------------------------------------------------------------------------------+--------+----------------------------------------------------------------------------------------+-------------+--------------+---------------------+----------------+---------+

The problem is introduced with PR https://github.com/cloudfoundry/credhub/pull/803. It adds a new migration file V57__add_lowercase_credential_name_column.sql. However, a previous migration with version V57.2 was executed some time ago. Could this issue be fixed by assigning a higher version number to the add_lowercase_credential_name_column migration file?
Please confirm where necessary:

[x] I have included a log output
[x] My log includes an error message
[x] I have included steps for reproduction

If you are a PCF customer with an Operation Manager (PCF Ops Manager) please direct your questions to support (https://support.pivotal.io/)

Fixed by #815


[Star Wars Saga Edition] Minor CSS changes

Submission Checklist
Required

[x] The pull request title clearly contains the name of the sheet I am editing.
[x] The pull request title clearly states the type of change I am submitting (New Sheet/New Feature/Bugfix/etc.).
[x] The pull request makes changes to files in only one sub-folder.
[x] The pull request does not contain changes to any json files in the translations folder (translation.json is permitted)

New Sheet Details

The name of this game is: <   >  (i.e. Dungeons & Dragons 5th Edition, The Dresden Files RPG)

The publisher of this game is: <   > (i.e. Wizards of the Coast, Evil Hat)

The name of this game system/family is: <   > (i.e. Dungeons & Dragons, FATE)

[ ] I have followed the Character Sheets Standards when building this sheet.

[ ] This sheet has been made on behalf of, or by, the game's publisher.
[ ] This game is not a traditionally published game, but a copy of the game rules can be purchased/downloaded/found at: <   >
[ ] This sheet is for an unofficial fan game, modification to an existing game, or a homebrew system.

Changes / Description

Made CT buttons more readable in dark mode.
Changed custom checkboxes to display better when browser zoom is not 100%.

Character Sheet Info Roll20 Internal Use only.


Work around "psf_fseek" bug

Something's wrong with the soundfile wheel packages for x86-64 Linux: https://github.com/MIT-LCP/wfdb-python/issues/486
An example is:
waveform_benchmark.py --input_record 82284982 --physionet_directory mimic4wdb/0.1.0/waves/p169/p16955095/82284982 --format_class waveform_benchmark.formats.wfdb.WFDBFormat516

I think this probably not a bug in wfdb.  I'm not sure what the problem is exactly.
As a workaround, pin the soundfile package to an older version (https://pypi.org/project/soundfile/0.11.0/).

Thanks @bemoody


grabber wont work

What steps will reproduce the problem?
clicking on any fav post or even searching anything.
What is the expected behavior? What do you get instead?
"no results" it just shows that whatever i do
How often does this problem occur?
What version of the program are you using? On what operating system?
Please provide any additional information below

Which sources did this occur on?

this seems to happen with any of the sankaku sites at the moment.

Thank you :^ )
Idk if its an ip problem really but lets hope the Dev work it out.
On 27 Jul 2017 00:31, Jack Vasti<EMAIL_ADDRESS>wrote:
If it's Sankaku, see issue #997https://github.com/Bionus/imgbrd-grabber/issues/997.
It's not really working for anyone at the moment. 😄
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Bionus/imgbrd-grabber/issues/1007#issuecomment-318188823, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATnU64QnphKPDSjI1JSdhIDg4cz7EVrPks5sR7A1gaJpZM4OjP0P.


Improve user operations audit logs.

Purpose

This commit allows the user operations involved with internal roles
to be logged in the audit log. Previously the data about the internal
roles were not considered for logging.

Resolves #1710

@jsdjayanga , Updated the PR as requested.

@jsdjayanga Could you please check and approve the PR.
Thanks,

stale

The same is addressed with https://github.com/wso2/carbon-kernel/pull/1737
Closing this PR as the new fix address all user operation level audit logs


Merge branch 'main' of https://github.com/SAP-samples/devtoberfest-2021 into main

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Requiring C++14

Bumping the version of C++ from 11 to 14 to support C++14. Once this lands, we can use C++14 features throughout gRPC code.

Do we know why the bloat increase?

Do we know why the bloat increase?

I briefly checked the result and the delta of bloaty test is 8728 bytes for libgrpc.so and 8316 bytes for libgrpc++.so which ended up exceeding the threshold of bloat/medium (16K) slightly.
From my reading on the .text section by comparing disassembled code, I don't think there is any significant regression here. It's mostly coming from the different behavior of compiler. (e.g. c++11 chose to "inline" a certain function but c++14 didn't, or vice versa) Code generation is slightly changed according to the compiler version (maybe some STL code has different code paths depending on the C++ standard), and this seems to have influenced the decision of whether or not to be inlined.

grpc_build_artifacts_multiplatform: running

Existing flaky tests:

Basic Tests C/C++ MacOS: b/TBD
Bazel RBE UBSAN C/C++: Timeout "test/core/end2end/h2_tls_test@resource_quota_server@poller=poll" b/151212019


[clean] Space Auto Remover - CH15

Run regex algo to suto remove spaces (as publisher required), replace half-width with full-width (i.e. "(" to "（") in suitable situations.

[ ] Need to check html rendering: numref, cite, math, etc. rendering

Job d2l-zh/PR-984/2 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-984/

Job d2l-zh/PR-984/3 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-984/


wip: adverbs...

Not sure about boxes and the ever present:
error[E0515]: cannot return value referencing temporary value

Currently very broken


Move Entrypoint files to inside /src

Expected Behavior
Move files like index.js to inside /src whilst keeping the modules working.
Current Behavior

Possible Solution

Steps to Reproduce (for bugs)

Context
Developers will have a slightly better overview

Fixed in #16

:tada: This issue has been resolved in version 0.1.0 :tada:


Parameter Parser Duplicates for Oracle Queries

observed in the MTRAC query  SQL_SMS_R
...
where
bdcuc.ROWID = bci_rowid
and
ROWNUM <= 5 * :SQLT_INT_ROWLIMIT
and
bci_submitdate >= :SQLT_DAT_START_DATE
and
bci_submitdate <= :SQLT_DAT_END_DATE
and
(
bc_trycount in(0,1,2,3,5,9)
or
bc_status in(4,5,16)
)
and
bc_msisdn_a like :SQLT_STR_SENDER
and
bci_msisdn = :SQLT_STR_RECEIVER
and
(
:SQLT_STR_SHORTID is null
or
BC_CONSOL like :SQLT_STR_SHORTID
)
and
(
:SQLT_STR_GENERATED is null
or
NVL(BC_GENERATED,0)
like
:SQLT_STR_GENERATED
)

Reopened for sqlparse based integration as a better solution


Portal Services not available and for replaced by Portal Site

The deployment of the application fails in the Cloud Foundry production account due to the deprecated Portal services.

Hello Hari,
Can you please share cf logs? We will look into this issue.
Thanks

Hello Anugrahg
Please find the logs
Deploying in org "Aarini Consulting B.V._aarini" and space "AppDevelopment"
Detected MTA schema version: "3"
No deployed MTA detected - this is initial deployment
Detected new MTA version: "1.3.10"
Service "shine-container" exists but doesnt have any bound applications
Service "shine-uaa" exists but doesnt have any bound applications
Processing service "sap-portal-services-client"...
Creating service "sap-portal-services-client" from MTA resource "sap-portal-services-client"...
Unexpected error: Controller operation failed: 403 Forbidden: Error creating service "sap-portal-services-client" from offering "portal-services" and plan "site-content": A service instance for the selected plan cannot be created in this organization. The plan is visible because another organization you belong to has access to it.
Processing service "shine-scheduler"...
Creating service "shine-scheduler" from MTA resource "shine-scheduler"...
Process failed: Unexpected error: Controller operation failed: 403 Forbidden: Error creating service "sap-portal-services-client" from offering "portal-services" and plan "site-content": A service instance for the selected plan cannot be created in this organization. The plan is visible because another organization you belong to has access to it.
Use "cf deploy -i 59831120 -a abort" to abort the process.
Use "cf deploy -i 59831120 -a retry" to retry the process.
Use "cf dmol -i 59831120" to download the logs of the process.
Regards
Harikishore


[Bug]: The usage data is not reflected on the customer portal for business users, despite significant activity being recorded by the users

Is there an existing issue for this?

[X] I have searched the existing issues

Description
The usage data is not being reflected on the customer portal for business users, despite significant activity being recorded by the users

Steps To Reproduce

pull nightly locally
create new business key with which is paid in customer portal
Trigger the usage pules
Now check the stats in the billing usage tab the Hours billed is not tracked correctly

Public Sample App
No response
Environment
Production
Severity
High (Blocker to building or releasing)
Issue video log
No response
Version
prod

closing the issue as there was some delayed and now its fixed


zuulproxy auto config, NoClassDefFoundError com/google/api/gax/rpc/EmptyRequestParamsExtractor

HI,
Found below dependency error after adding spring cloud zuul proxy dependency
tried manually adding google api gax dependency,  new error was thrown
below is the original error
2018-01-23 23:03:27.058 ERROR [api-gateway,,,] 44432 --- [ost-startStop-1] o.s.b.web.embedded.tomcat.TomcatStarter  : Error starting Tomcat context. Exception: org.springframework.beans.factory.UnsatisfiedDependencyException. Message: Error creating bean with name 'org.springframework.cloud.netflix.zuul.ZuulProxyAutoConfiguration': Unsatisfied dependency expressed through field 'requestCustomizers'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'apacheHttpRibbonRequestCustomizer' defined in class path resource [org/springframework/cloud/sleuth/instrument/zuul/TraceZuulAutoConfiguration.class]: Unsatisfied dependency expressed through method 'apacheHttpRibbonRequestCustomizer' parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sleuthTracer' defined in class path resource [org/springframework/cloud/gcp/trace/autoconfig/StackdriverTraceAutoConfiguration.class]: Unsatisfied dependency expressed through method 'sleuthTracer' parameter 4; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'traceSpanReporter' defined in class path resource [org/springframework/cloud/gcp/trace/autoconfig/StackdriverTraceAutoConfiguration.class]: Unsatisfied dependency expressed through method 'traceSpanReporter' parameter 3; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'traceConsumer' defined in class path resource [org/springframework/cloud/gcp/trace/autoconfig/StackdriverTraceAutoConfiguration$TraceConsumerConfiguration.class]: Unsatisfied dependency expressed through method 'traceConsumer' parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'traceServiceClientTraceConsumer' defined in class path resource [org/springframework/cloud/gcp/trace/autoconfig/StackdriverTraceAutoConfiguration$TraceConsumerConfiguration.class]: Unsatisfied dependency expressed through method 'traceServiceClientTraceConsumer' parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'traceServiceClient' defined in class path resource [org/springframework/cloud/gcp/trace/autoconfig/StackdriverTraceAutoConfiguration$TraceConsumerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.google.cloud.trace.v1.TraceServiceClient]: Factory method 'traceServiceClient' threw exception; nested exception is java.lang.NoClassDefFoundError: com/google/api/gax/rpc/EmptyRequestParamsExtractor

@inventoryz have you given M2 a try against Spring Boot 2? Thanks!

I tried M2 today, compilation works fine.


Re-order level keep blank for item created without re order level

[ ] Currently showing 'zero' in re-order field.

issue fixed !


Fix cuda pointer ownership problem with user/externally allocated pointer

When user wraps externally allocated cuda memory with MemoryPointer, the expected usage is that the MemoryPointer instance owns the allocated memory.  However, due to initial assumption for internal use, the MemoryPointer instance was not acquiring a reference to the buffer (refct=0 initially).  This leads to pre-mature freeing of the buffer when derived pointer is freed even though the parent MemoryPointer is still alive.  This patch fixes this issue.
As for internal use, a new RCPointer is created that preserve the old behavior, where derive pointers are controlling the lifetime of the allocation.

Class name changed.

Looks good.  Will merge once Travis-CI finishes.

Codecov Report

Merging #3266 into master will increase coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master   #3266      +/-   ##
=========================================
+ Coverage   81.09%   81.1%   +<.01%
=========================================
  Files         386     386
  Lines       76285   76285
  Branches     8575    8575
=========================================
+ Hits        61867   61871       +4
+ Misses      13100   13097       -3
+ Partials     1318    1317       -1


Add Solution for Find All Good Indices & Longest Subarray With Maximum Bitwise AND

Problem: Find All Good Indices
Time Complexity: O(N)
Space Complexity: O(N)
Difficulty: Medium
Topics: Prefix Sum, Array
Problem: Longest Subarray With Maximum Bitwise AND
Time Complexity: O(N)
Space Complexity: O(1)
Difficulty: Medium
Topics: Array, Maths

this is amazing @mohitmallick17
thanks for the contribution in my repo and please share in social media and tag me on twitter


Nested ngFor

Is it possible to make virtual scroll working for nested ngFor ? I need to make table with possibility to collapse groups.
I'm trying such simple example and all attribute items are rendered
<virtual-scroll [items]="levels" (update)="viewPortLevels = $event">

        {{group.name}}

            {{attribute.channelAttribute.name}}

</virtual-scroll>

This is not currently an officially supported feature. Would either of you be willing to attempt to code this feature & submit a pull request? Thanks.

One issue with this is the childItems might become variable size (which we partially-support, but our implementation is naive so nested ngFor could potentially break it). A lot of that would depend on if group.attributes was read-only after the datasource is initially loaded or if it could change afterwards (we cache the calculated child item pixel dimensions for performance reasons rather than re-measuring constantly).
I think your code should work, but you have some typos. I think this seems more accurate (untested):
<virtual-scroll [items]="levels" (update)="viewPortLevels = $event">

        {{group.name}}

            {{attribute.channelAttribute.name}}

</virtual-scroll>

Closing this since I haven't received a response from the original poster. Please re-open if you continue to experience this issue.
I originally flagged this as a feature request, but on second thought, I think it might actually work with the current implementation of the component (possibly requiring the variable size child items flag to be enabled).


Emitter Tip

Hi there! I was wondering what the emitter tip is for. I can't put my finger on where on the wand that connects to

Hi! The emitter tip is made to fit inside the GBfans tube (https://www.gbfans.com/shop/pack-parts/clear-acrylic-frosted-gun-tip/) so that is what you see when you look into the barrel. I printed it in clear resin så the light will shine thru. :)

See image 😊

ah gotcha. where did you come up with that idea?

Sorry, did forget to answer this, This idea is just something i made up. No souce for it but i thought it would be nice to have something to cap it of with.


Card Priority per AutoSkill configuration

idea is that as na now has skadi and quick is now a big thing, wouldn't it make more sense to put the card priorities from more options into the auto skill configs? this way you can set the card priorities for each auto skill set instead of doing it in general which makes up for further configuration possibilities, I don't know if that's possible tho as of now

We already have it planned.
We also have other things to move to AutoSkill configs so the UI might get a bit cluttered, so we're thinking about a redesign.

that's nice, I happened to come across that idea bc of the lucky fact that I got skadi myself so there's that


Implementation of Kubernetes: set namespace command

This implements and resolves Issue #265 , wherein now the Namespace command is available via the Context menu in explorer as well as via command palette.
Signed-off-by: Kamesh Sampath<EMAIL_ADDRESS>

@itowlson  - just force pushed things, to make it easier for review, I have tried to address most of your comments

I think this placement is problematic. The handler is likely to be an inline code block representing the core of the calling function; the placeHolder could therefore end up separated by 10-20 lines from the call to promptKindName, so it is very hard for the reader to connect this random string back to the role it plays. An alternative might be to add it to the opts record?

But I do have incorporated it partially via opts and using that for getting the custom placeholder and prompt. I guess this is what you meant the place where its called and place where its used ??

all these formatting changes are side effects of me turning off the auto format on save ;) ..  if we can get these rules into tslint and/or .editorconfig that saves a lot of energy here

@kameshsampath Do you have the tslint extension? We do actually have both .editorconfig and tsconfig: https://github.com/azure/vscode-kubernetes-tools/blob/master/tslint.json && https://github.com/azure/vscode-kubernetes-tools/blob/master/.editorconfig

thanks @itowlson  @bnookala  for reviewing and accepting my first contribution :)