Performance improvements for the uint256 and uint160 classes

Do you have benchmark on the improvement?

I don't have the overall performance difference as it would be difficult to quantify. I have prepared some benchmarks for the implemented changes which should give you an idea of the benefits.
Benchmarks source code: Benchmarks.zip
Statistics

@maciejzaleski would be interesting to try another updates: applying [MethodImpl(MethodImplOptions.AggressiveInlining)] on top of Utils.ToBytes, utils ToUInt32, and so on
we could have a lot of performance improvement if the compiler didn't inlined them already

I have just run another test purely to verify performance difference of pn[] vs pn0-pn7.
Surprisingly the existing approach of using pn0-pn7 is more optimal.

Method
ArraySize
Mean
Error
StdDev
Ratio
Rank
Gen 0/1k Op
Gen 1/1k Op
Gen 2/1k Op
Allocated Memory/Op

CreateUInt256_Current
1
22.43 ns
0.1407 ns
0.1316 ns
1.00
1
0.0133
-
-
56 B

CreateUInt256_Proposed
1
28.19 ns
0.1765 ns
0.1565 ns
1.00
1
0.0209
-
-
88 B

@maciejzaleski would be interesting to try another updates: applying [MethodImpl(MethodImplOptions.AggressiveInlining)] on top of Utils.ToBytes, utils ToUInt32, and so on
we could have a lot of performance improvement if the compiler didn't inlined them already

I had a look on this but I'm not sure this is a good idea. You need to annotate methods which you want to be inlined and given that inlining will consume more memory and we use uint256 a lot it is not a good idea.

@maciejzaleski would be interesting to try another updates: applying [MethodImpl(MethodImplOptions.AggressiveInlining)] on top of Utils.ToBytes, utils ToUInt32, and so on
we could have a lot of performance improvement if the compiler didn't inlined them already

I had a look on this but I'm not sure this is a good idea. You need to annotate methods which you want to be inlined and given that inlining will consume more memory and we use uint256 a lot it is not a good idea.

What you mean about "consume more memory"?
Inlining should increase only the size of the compiled code, not an issue

Have you tried with my version of uint256?
Not yet but its definitely coming in one of the next releases.

Yeah I agree with Nicolas, if we can use stack instead heap for all these hash allocations should have way less memory fragmentation. If your looking for a volunteer to port some of the span code over from NBitcoin, I'm game!

@mikedennis sure the problem is we target netstandard (you'll have to use debug flags)

@dangershony netstandard 2.1 will have span so you can at least prepare it. Or just target both .netcoreapp2.1 and  netstandard and ifdef as I did in NBitcoin.

I suggest we have equivalent implementations of basic primitives (such as uint256 and BitcoinStream) to NBitcoin so we should bring over any improvements and any changes we propose first get them in to NBitcoin.
@mikedennis in that case lets get over the changes to IBitcoinSerializer and uint256 using compiler directives (as done in NBitcoin)
@MithrilMan ?

I suggest we have equivalent implementations of basic primitives (such as uint256 and BitcoinStream) to NBitcoin so we should bring over any improvements and any changes we propose first get them in to NBitcoin.
@mikedennis in that case lets get over the changes to IBitcoinSerializer and uint256 using compiler directives (as done in NBitcoin)

Sounds good - I'll start looking into that.

Personally I don't like having to pollute the code with directives to target different platforms, we have either to decide if we target dotnetcore or netstandard because we have already lot of project that target directly dotnetcore so this already confuses me about what direction we are going to take.
Unluckily what we need in dotnetcore will be implemented in .netstandard 3.0 and there isn't even an ETA because netstandard release pace is a lot slower than dotnetcore
Moreover .netstandard 3.0 will be used, IIR, from .Net 4.8 forward
We have to decide if we really need to support .netstandard and why, then we need to decide what to do with current solution that has mixed targets.
P.S.
I think some of the project currently require dotnetcore, like smartcontract, for technical reasons but I cannot confirm this, maybe @codingupastorm @rowandh can help about this

here an interesting issue about the need for netstandard
https://github.com/dotnet/standard/issues/859#issuecomment-435348206

🤔  Unless stated otherwise by the architecture the sensible way is to target netstandard for now and add some compilation directives (temporary). But I do see the quick win of just targeting dotnetcore for now (specially that we don't plan to target different platforms in the near future), swapping to netstandard should in theory just be a change to the compilation target and that's it.

My preference is to do the multi-targeting/conditional compiles (like NBitcoin) for now but once we can upgrade to .net standard 2.1 then clean all that out. I don't think it should be too long and we can try to keep it to serialized and uint256 classes for now.
I thought they would have had 2.1 out already but seems to be taking a while.

NBitcoin keep compatibility up to .NETStandard 1.1, so my pragma are not soon removed :p

NBitcoin keep compatibility up to .NETStandard 1.1, so my pragma are not soon removed :p

this is awesome, fortunately we don't have that limitation.

@dangershony @MithrilMan Working on implementing span will track that work in #1871

@mikedennis we agreed internally to move all our projects to dotnetcore2.2, so if you don't want to waste time with directives wait few days or target already the dotnetcore2.2

@MithrilMan Ok cool that will make this much easier! I've taken a quick look at know where the touch points are, so should be pretty easy once we are running netcoreapp2.2

@mikedennis I've updated Jeremy's .net core 2.2 upgrade and it is pretty much ready to be merged. We are just awaiting side chain work to be finished and as soon as it is we will merge the upgrade PR and then we can implement these changes. Should be next week!

Closing as we will raise an internal issue to implement spans once we upgrade to .net Core 2.2.


[fix issue] fix docker compose issue on arm64

I still encounter issue with this fix, will raise new one, once case passed on arm64 distro


[QPROF] Issue with qprof

Hello VerticaPy team,
I have encountered a bug in qprof.py, observed in version: '1.0.0-2—12272023-aacb5b9de460f1be7acecaa5238c151109e76acb'. The issue arises when request is not defined, but statement_id and transaction_id are specified, leading to len(self.transactions) == 0.
        if isinstance(request, tuple) and len(request) == 2:
            request = [request]
        if isinstance(request, list):
            for tr in request:
                if isinstance(tr, int):
                    self.transactions += [(tr, 1)]
                elif isinstance(tr, tuple):
                    if (
                        len(tr) == 2
                        and isinstance(tr[0], int)
                        and isinstance(tr[1], int)
                    ):
                        self.transactions += [tr]
            request = None

I resolved my errors by adding a check for a None request:
        if isinstance(request, NoneType):
            if isinstance(transaction_id, int) and isinstance(statement_id, int):
                self.transactions = [(transaction_id, statement_id)]
            elif isinstance(transaction_id, int):
                self.transactions = [(transaction_id, 1)]  # Default statement_id to 1

The observed errors included:
---------------------------------------------------------------------------
MissingRelation                           Traceback (most recent call last)
Cell In[12], line 3
      1 from verticapy.performance.vertica import QueryProfiler
----> 3 qprof = QueryProfiler(
      4     statement_id=2,
      5     transaction_id=45035996283777382, ofile.
      6     target_schema='tests',
      7     overwrite=True,
      8 )

File ~/git/VerticaPy/verticapy/_utils/_sql/_collect.py:243, in save_verticapy_logs.<locals>.func_prec_save_logs(*args, **kwargs)
    240 json_dict = {**json_dict, **kwargs}
    241 save_to_query_profile(name=name, path=path, json_dict=json_dict)
--> 243 return func(*args, **kwargs)

File ~/git/VerticaPy/verticapy/performance/vertica/qprof.py:900, in QueryProfiler.__init__(self, request, key_id, resource_pool, transaction_id, statement_id, target_schema, overwrite, add_profile)
    897         self.target_schema = copy.deepcopy(target_schema)
    899 self.overwrite = overwrite
--> 900 self._create_copy_v_table()
    902 # Setting the request.
    903 if not (hasattr(self, "request")):

File ~/git/VerticaPy/verticapy/performance/vertica/qprof.py:1026, in QueryProfiler._create_copy_v_table(self)
   1024 new_table = f"qprof_{table}_{self.key_id}"
   1025 if table == "dc_requests_issued" and len(self.transactions) == 0:
-> 1026     self.transactions = _executeSQL(
   1027         f"""SELECT
   1028                 transaction_id,
   1029                 statement_id
   1030             FROM {new_schema}.{new_table}
   1031             ORDER BY
   1032             time DESC,
   1033             transaction_id DESC,
   1034             statement_id DESC;""",
   1035         title="Getting the transactions and statement ids.",
   1036         method="fetchall",
   1037     )
   1038     self.transactions = [tuple(tr) for tr in self.transactions]
   1039     if len(self.transactions) == 0:

File ~/git/VerticaPy/verticapy/_utils/_sql/_sys.py:181, in _executeSQL(query, title, data, method, path, print_time_sql, sql_push_ext, symbol)
    179         cursor.copy(query, f)
    180 else:
--> 181     cursor.execute(query)
    182 elapsed_time = time.time() - start_time
    183 if conf.get_option("time_on") and print_time_sql:

File /usr/local/lib/python3.9/site-packages/vertica_python/vertica/cursor.py:188, in Cursor.handle_ctrl_c.<locals>.wrap(self, *args, **kwargs)
    186 def wrap(self, *args, **kwargs):
    187     try:
--> 188         return func(self, *args, **kwargs)
    189     except KeyboardInterrupt:
    190         self.connection.cancel()

File /usr/local/lib/python3.9/site-packages/vertica_python/vertica/cursor.py:266, in Cursor.execute(self, operation, parameters, use_prepared_statements, copy_stdin, buffer_size)
    264     if parameters:
    265         operation = self.format_operation_with_parameters(operation, parameters)
--> 266     self._execute_simple_query(operation)
    268 return self

File /usr/local/lib/python3.9/site-packages/vertica_python/vertica/cursor.py:786, in Cursor._execute_simple_query(self, query)
    784 self._message = self.connection.read_message()
    785 if isinstance(self._message, messages.ErrorResponse):
--> 786     raise errors.QueryError.from_error_response(self._message, query)
    787 elif isinstance(self._message, messages.RowDescription):
    788     self.description = self._message.get_description()

MissingRelation: Severity: ERROR, Message: Relation "tests.qprof_dc_requests_issued_0700120aa5bf11eeb925acde48001122" does not exist, Sqlstate: 42V01, Routine: throwRelationDoesNotExist, File: /data/jenkins/workspace/RE-DevBuilds/RE-Build-Dev-Pipeline/server/vertica/Catalog/CatalogLookup.cpp, Line: 4163, Error Code: 4568, SQL: 'SELECT transaction_id, statement_id FROM tests.qprof_dc_requests_issued_0700120aa5bf11eeb925acde48001122 ORDER BY time DESC, transaction_id DESC, statement_id DESC'

And after the fix:
Some tables seem to not exist...
Creating a copy of the performance tables...

The key used to build up the tables is: 12cbe5eca5c811eea345acde48001122

You can access the key by using the 'key_id' attribute.
Copy of v_internal.dc_requests_issued created in tests.qprof_dc_requests_issued_12cbe5eca5c811eea345acde48001122
......

Additionally, I suggest an improvement regarding the use of v_temp_schema.
Currently, the code:
if new_schema == "v_temp_schema":
    sql += f"LOCAL TEMPORARY TABLE {new_table} ON COMMIT PRESERVE ROWS "

Is designed to work exclusively with v_temp_schema. In environments without v_temp_schema, this limitation can cause issues. A simple and effective solution would be to allow users to specify an alternative schema. This could be done by adding a parameter like alternative_schema. When set, this parameter would replace v_temp_schema in the code, making it more flexible for different setups
Thanks you ,
Yakir Gibraltar
Taboola

Thanks a lot Yakir for your feedback, we will fix that.
To be able to work with multiple transactions, we added a parameter 'key_id'. It is generated the first time we store the perf tables. I hope you got it. Also, we've published the first iteration of the new doc. It will be completed for the next patch release 1.0.1: https://www.vertica.com/python/documentation/1.0.x/html/api/verticapy.performance.vertica.qprof.QueryProfiler.html#verticapy.performance.vertica.qprof.QueryProfiler

@yakirgb  For the 'alternative_schema' what do you expect? You still can pick the schema you want as 'target_schema'. Indeed, by writing target_schema='MYSCHEMA', the code will skip the 'v_temp' check.
You want a back up in case the 'target_schema' does not exist?

Hi @oualib ,
I want to  run qprof with temporary tables, also if "new_schema!=v_temp_schema" and use custom schema for temp tables.
All the code excepting for v_temp_schema to built temp table.
Like:
{code}
# Building the target_schema
if target_schema == "v_temp_schema":
self.target_schema = self._v_temp_schema_dict()
{code}
or:
{code}
@staticmethod
def _v_temp_schema_dict() -> dict:
return {
"v_internal": "v_temp_schema",
"v_monitor": "v_temp_schema",
}
{code}
or:
{code}
if new_schema == "v_temp_schema":
sql += f"LOCAL TEMPORARY TABLE {new_table} ON COMMIT PRESERVE ROWS "
{code}
I want to call for QueryProfiler with:
{code}
qprof = QueryProfiler(
transaction_id=45035996273800581,
statement_id=48,
target_schema="tests",
use_temp_tables=true
{code}
Thank you,
Yakir Gibraltar

@yakirgb  is it not better to have ONE parameter named 'transactions' which can be:

An integer (transaction_id=int and statement_id=1)
A tuple (tr_id, st_id)
A list of tuples [(tr_id, st_id) ...]
A str representing the query
Instead of so many parameters?

@yakirgb is it not better to have ONE parameter named 'transactions' which can be:
It's a great idea, sound great for me ,
I see you already added docs for this option:

    transactions: list
        ``list`` of ``tuples``:
        ``(transaction_id, statement_id)``.
        It includes all the transactions
        of the current schema.
    transaction_id: int
        Current Transaction ID.
    statement_id: int
        Current Statement ID.

Maybe my env not fully updated or this option not ready :
from verticapy.performance.vertica import QueryProfiler

qprof = QueryProfiler(
    transactions=(45035996283777382,1),
    target_schema='v_temp_schema',
)

Output:
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[18], line 3
      1 from verticapy.performance.vertica import QueryProfiler
----> 3 qprof = QueryProfiler(
      4     transactions=(45035996283777382,1),
      5     target_schema='v_temp_schema',
      6 )

File ~/git/VerticaPy/verticapy/_utils/_sql/_collect.py:243, in save_verticapy_logs.<locals>.func_prec_save_logs(*args, **kwargs)
    240 json_dict = {**json_dict, **kwargs}
    241 save_to_query_profile(name=name, path=path, json_dict=json_dict)
--> 243 return func(*args, **kwargs)

TypeError: __init__() got an unexpected keyword argument 'transactions'

Thank you,
Yakir Gibraltar

@yakirgb it is just a question so I reimplement the object. Do you think it's better? The goal is to have a version stable for 1.0.2.

Yes, it's sound better.

Ok @yakirgb, you'll get this parameter in the next version. Thanks a lot for your feedback!

@yakirgb You can now try the new methodology with 'transactions' param.
I hope you're enjoying VerticaPy, please let us know if there are some missing functionalities we could possibly implement.
Happy new year!

Thank you, happy new year.

Hi @oualib , LMK if open a new ticket (also we have Vertica support, i'm fine with open support ticket if needed),
Tested with transactions and getting the following error :
from verticapy.performance.vertica import QueryProfiler

qprof = QueryProfiler(
    transactions=(148618788054116727,30),
    target_schema="v_temp_schema"
)

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[15], line 3
      1 from verticapy.performance.vertica import QueryProfiler
----> 3 qprof = QueryProfiler(
      4     transactions=(148618788054116727,30),
      5     target_schema="v_temp_schema"
      6 )

File ~/git/VerticaPy/verticapy/_utils/_sql/_collect.py:244, in save_verticapy_logs.<locals>.func_prec_save_logs(*args, **kwargs)
    241 json_dict = {**json_dict, **kwargs}
    242 save_to_query_profile(name=name, path=path, json_dict=json_dict)
--> 244 return func(*args, **kwargs)

File ~/git/VerticaPy/verticapy/performance/vertica/qprof.py:934, in QueryProfiler.__init__(self, transactions, key_id, resource_pool, target_schema, overwrite, add_profile, check_tables)
    931         self.transactions += [(transaction_id, statement_id)]
    933 if len(self.transactions) == 0 and isinstance(key_id, NoneType):
--> 934     raise ValueError("No transactions found.")
    936 elif len(self.transactions) != 0:
    937     self.transaction_id = self.transactions[0][0]

ValueError: No transactions found.

Same error also with:
qprof = QueryProfiler(
<PHONE_NUMBER>54116727,30),
    target_schema="v_temp_schema"
)

Also same error without target_schema.
The statement existing on DB:
yakir.g=> select time,transaction_id,statement_id from v_internal.dc_requests_issued where transaction_id=148618788054116727 and statement_id=30;
-[ RECORD 1 ]--+------------------------------
time           | 2023-12-31 10:49:43.028353+00
transaction_id |<PHONE_NUMBER>54116727
statement_id   | 30

And possible another issue, add key_id generate error:
from verticapy.performance.vertica import QueryProfiler

qprof = QueryProfiler(
<PHONE_NUMBER>54116727,30),
    key_id=123
)
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
Cell In[26], line 3
      1 from verticapy.performance.vertica import QueryProfiler
----> 3 qprof = QueryProfiler(
      4<PHONE_NUMBER>54116727,30),
      5     key_id=123
      6 )

File ~/git/VerticaPy/verticapy/_utils/_sql/_collect.py:244, in save_verticapy_logs.<locals>.func_prec_save_logs(*args, **kwargs)
    241 json_dict = {**json_dict, **kwargs}
    242 save_to_query_profile(name=name, path=path, json_dict=json_dict)
--> 244 return func(*args, **kwargs)

File ~/git/VerticaPy/verticapy/performance/vertica/qprof.py:955, in QueryProfiler.__init__(self, transactions, key_id, resource_pool, target_schema, overwrite, add_profile, check_tables)
    952 self._create_copy_v_table()
    954 # SETTING THE requests.
--> 955 self._set_request()
    957 # SETTING THE queries durations.
    958 self._set_qduration()

File ~/git/VerticaPy/verticapy/performance/vertica/qprof.py:1283, in QueryProfiler._set_request(self)
   1277     except TypeError:
   1278         raise QueryError(
   1279             f"No transaction with transaction_id={tr_id} "
   1280             f"and statement_id={st_id} was found in the "
   1281             "v_internal.dc_requests_issued table."
   1282         )
-> 1283 self.request = self.requests[self.transactions_idx]

IndexError: list index out of range

Thank you, Yakir.

@yakirgb , I just corrected the small bug. Can you please try again?

Hi @oualib , issue resolved.
Very nice tool compare to old qprof bash.
Thank you

AMAZING. Thanks a lot @yakirgb for your feedback. It matters a lot to us.
Please let us know if you need some specific tool to make your tasks easier. If it has a good business value, we'll be glad to add it to the roadmap.


Request to add a License

Hi Michiel,
I just found your project on GitHub and find it incredibly interesting. I noticed that it currently lacks a license. Adding a licence to your project will clarify how others can use/modify/distribute the code you've made public. You did a great job in this project and it'd be a shame not to put your work to use.
I'm working on a project in Julia where we want to do differentiable sequence alignment and being able to use your code would be an incredible help!
Thanks in advance considering my request.
Best regards,
Anne

Hi Anne,
Thanks for your interest. I added an MIT licence. We spent a lot of work on this project (including a draft), but we got scooped before finishing it. I would be delighted if it would be of some use to someone. Feel free to contact me by mail if you want some additional material.
Kind regards,
Michiel


[Bug] Wallet Connect - Fireblocks

Describe the bug
After logging in using wallet connect and fireblocks, any time I try to do a transaction of any sort I get the error Uncaught (in promise) {code: -32000, message: 'Server error'}
Steps To Reproduceå
Steps to reproduce the behavior:

Go to https://fireblocks-minimalist-test.vercel.app/
Click on Connect
Choose Wallet connect and scan the QR code using a fireblocks testnet account
When finishing log in, click on Stake 1 NEAR
Check the console

Error description
It is expected to get a QR code to scan with fireblocks and stake 1 NEAR
Screenshots

Desktop:

OS : Linux zorin
Browser : Chrome
Browser Version :  Version 119.0.6045.105 (Official Build) (64-bit)

Additional Context
In order to make this simpler, I've created this minimalist example. The vercel link above points to the same repo.
To replicate the real scenario, I left the @near-wallet-selector/wallet-connect version to "6.0.0" since when updating it into the real project has an error and when using the newest in this minimalist example I get another error, telling Failed to execute 'postMessage' on 'DOMWindow': The target origin provided ('https://verify.walletconnect.com')  does not match the recipient window's origin ('https://fireblocks-minimalist-test.vercel.app') when clicking on Wallet connect in the modal

Hi, @Calcifer1001 thanks for raising this issue.

updating it into the real project has an error and when using the newest in this minimalist example I get another error, telling Failed to execute 'postMessage' on 'DOMWindow': The target origin provided ('https://verify.walletconnect.com')  does not match the recipient window's origin ('https://fireblocks-minimalist-test.vercel.app') when clicking on Wallet connect in the modal

This error can be ignored or you can verify your domain in WalletConnect https://cloud.walletconnect.com/app - Click Project Id then Domain verification
We would appreciate it if you create a demo with a version of @near-wallet-selector/wallet-connect v7.0.3 or higher since any version lower than 7.0.0 is not implemented according to the bridge wallets standard.

Choose Wallet connect and scan the QR code using a fireblocks testnet account

How can we get a Fireblocks testnet account?

It is expected to get a QR code to scan with fireblocks and stake 1 NEAR

When you are connected with a wallet with WalletConnect you only get prompted with the QR code to connect with that wallet and not every time you signAndSendTransaction(s) once the near_signAndSendTransaction or near_signAndSendTransaction is triggered with a transaction that needs confirmation, the wallet should automatically prompt you to confirm.

I'll try what you suggested.
Regarding fireblocks, you should be able to get a testnet account here

Hi, while I wait for Fireblocks to activate the account for me.
I tested your demo with the web-examples of WalletConnect where we added support for NEAR:
Wallet Example (testnet): https://react-wallet.walletconnect.com/
you might need to switch to settings tab and enable testnets
I noticed that in the transaction to stake 1 NEAR the receiverId is missing:

I am seeing this exact issue too. I pulled down the examples repository and installed and set my Wallet connect ID but I can't even get it to form a connection.

Here's a video trying out this example provided above: https://fireblocks-minimalist-test.vercel.app/
demo.webm

I am seeing this exact issue too. I pulled down the examples repository and installed and set my Wallet connect ID but I can't even get it to form a connection.

What examples repository have you pulled down?

Hey @kujtimprenkuSQA . I am using the react app in the examples for the wallet-connector. When I try and connect to fireblocks it just shows rejected. I see your dependency bump. I will try that now.

Hey @kujtimprenkuSQA . I am using the react app in the examples for the wallet-connector. When I try and connect to fireblocks it just shows rejected. I see your dependency bump. I will try that now.

Hi, can you move to this branch locally: https://github.com/near/wallet-selector/tree/bump-wallet-connect-deps

run: yarn && yarn build:all
Set WalletConnect projectId here
run yarn nx serve react

Try connecting the fireblocks wallet again.
If this does not work could you remove near_signMessage method and refresh the example and try to connect again and see if this is causing any issues.
I will see to find a way to get a Fireblocks account and troubleshoot it asap.

We just published a new version of wallet selector v8.7.2 in which we bumped the WalletConnect dependencies to the latest version, can you try it with this version and see how it goes?
Tested WalletConnect option with https://react-wallet.walletconnect.com/ and https://optowallet.com/ (now deprecated, but still works fine) wallet-connect option is working fine with these two.

Note: We did not change any functionality on our side in the wallet-connect option with the exception of adding a new method near_signMessage which should not be a breaking change unless Fireblocks has some specific implementation that does not allow new methods.

We have applied for an account in Fireblocks but we never got any reply from them, is there any other way we could get an account?

Hi, @Calcifer1001 & @kieranbop1990 have you tested the latest version of Wallet Selector, are you still having issues with Fireblocks?

I have requested a demo from Fireblocks multiple times and have emailed them this week, still waiting for a response from them.

Hi, @Calcifer1001 & @kieranbop1990 have you tested the latest version of Wallet Selector, are you still having issues with Fireblocks?

Hi @Calcifer1001 @kieranbop1990 any news regarding this 👆 ? Thanks!

Hi @Calcifer1001  @kieranbop1990 , I will close this issue for now, as there has been no reply for a while. Feel free to reopen it. Thanks!


Extremely confusing names and sites for beginners

[Enter feedback here]
Cloud App and Security, which portal? I'm new to this world and I already hate it! Please add links to those fancy names as I am confused as hell
Here is a text file I generated to clear up the confusion as the docs say NOTHING where to connect to rather than just a long names that can mean anything, everything and nothing at the same time

Microsoft 365 admin center is admin.microsoft.com
Microsoft 365 security center is security.microsoft.com
Office 365 Security & Compliance protection.office.com
....... Hang on a sec, what is the difference between Microsoft 365 and Office 365?
Microsoft 365 compliance center compliance.microsoft.com
....... So Microsoft 365 Security and Compliance is different from Microsoft 365 compliance center?
Microsoft Defender Security Center securitycenter.windows.com which was renamed to Microsoft Defender for Endpoint which takes you to security.microsoft.com which is now Microsoft 365 security center As clear as mud!
Microsoft Azure portal.azure.com
Microsoft Endpoint Manager admin center (Intune) endpoint.microsoft.com
Microsoft Defender for Identity CompanyName.atp.azure.com
Cloud App Security Portal CompanyName.portal.cloudappsecurity.com
Exchange admin center outlook.office365.com (yep, because Exchange is Outlook and it is inside the Office domain, makes no sense at all!
SharePoint Admin center is YourCompany-admin.sharepoint.com
Teams Admin Center admin.teams.microsoft.com

Come on Microsoft! Want to attract people to this platform? Then keep things simple! This is really confusing!

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 8fbda4c0-2222-b67a-615e-261fea7f3f05
Version Independent ID: 13241ed3-46e9-5821-4760-4bdb9564c69e
Content: Working with discovered apps in Cloud App Security
Content Source: CloudAppSecurityDocs/discovered-apps.md
Service: cloud-app-security
GitHub Login: @dcurwin
Microsoft Alias: dacurwin

Thank you for your comment, We will investigate and get back to you.

@Anoni-Mouse - I really appreciate your feedback here. I know that since the products you mentioned are constantly being improved and updated, there can be confusion about the names and links for each of that. That can be certainly frustrating for new users of the product, and we certainly want to make the process for people like you, who are beginning to use them, as smoothly as possible.
I looked at your really helpful list, and reviewed Cloud App Security documentation (for which I'm responsible), and added quite a few links to the relevant portals or other sites when they're mentioned. I can't change the names of the products and services, but I can modify the documentation to make it as clear as possible where to go.
Please feel free to let me know if you see any pages in the Cloud App Security documentation that could use updating for clarity in this regard. I'll leave this issue open for now, and wait for your additional feedback. Thanks!

You guys rock! Thanks for making it more simple for beginners

From: David Curwin @.>
Sent: Tuesday, May 25, 2021 12:08:45 PM
To: MicrosoftDocs/CloudAppSecurityDocs @.>
Cc: Anoni Mouse @.>; Mention @.>
Subject: Re: [MicrosoftDocs/CloudAppSecurityDocs] Extremely confusing names and sites for beginners (#386)
@Anoni-Mousehttps://github.com/Anoni-Mouse - I really appreciate your feedback here. I know that since the products you mentioned are constantly being improved and updated, there can be confusion about the names and links for each of that. That can be certainly frustrating for new users of the product, and we certainly want to make the process for people like you, who are beginning to use them, as smoothly as possible.
I looked at your really helpful list, and reviewed Cloud App Security documentation (for which I'm responsible), and added quite a few links to the relevant portals or other sites when they're mentioned. I can't change the names of the products and services, but I can modify the documentation to make it as clear as possible where to go.
Please feel free to let me know if you see any pages in the Cloud App Security documentation that could use updating for clarity in this regard. I'll leave this issue open for now, and wait for your additional feedback. Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/CloudAppSecurityDocs/issues/386#issuecomment-847738329, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AJN7TNJL5B5X3K5YIPW3YQDTPNZK3ANCNFSM45ME2XPA.

We're always happy to help!
If it's ok with you, I'll close this GitHub issue, but feel free to open a new one any time you see pages where we could improve clarity.

Yes you can close the request. Thanks a ton

From: David Curwin @.>
Sent: Tuesday, May 25, 2021 12:48:23 PM
To: MicrosoftDocs/CloudAppSecurityDocs @.>
Cc: Anoni Mouse @.>; Mention @.>
Subject: Re: [MicrosoftDocs/CloudAppSecurityDocs] Extremely confusing names and sites for beginners (#386)
We're always happy to help!
If it's ok with you, I'll close this GitHub issue, but feel free to open a new one any time you see pages where we could improve clarity.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/CloudAppSecurityDocs/issues/386#issuecomment-847763391, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AJN7TNMZKJK7A3YKQLWEUU3TPN57PANCNFSM45ME2XPA.


Web server proxy for safe access to Azure Storage?

The Titanium project is very interesting, and I have a specific scenario in mind for the Azure Storage. I would like some guidance to figure out if Titanium can be used for this scenario.
The Azure Storage (blobs, queues, tables) is great but the storage keys only comes as read+write. Yet, for many scenarios it would be much safer to have only a read access (ex: backup agent, production monitoring agent, etc). Indeed, a read+write access to a production system is inherently risky.
Thus, I am considering a setup that involves the HTTP proxy. The proxy would only forward the safe requests with a filter the HTTP verbs; plus the proxy would perform a API key replacement as well. So that the proxied agent hold only proxy keys and not real storage keys.
In order to avoid mishaps relative to the keys read+write, the HTTP proxy is intended to be hosted on Azure itself, and fully isolated from all proxied agents. The agent never gets any access to the real storage keys, only to the proxy keys. This prevents any destructive behavior from the proxied agents.
Now this flavor of HTTP proxy is intended to inbound HTTP traffic; while the current Titanium flavor seems to capture output HTTP traffic.
Could someone shed some light on how Titanium could be used in such a scenario?  Thanks!

You are probably talking about making this  a transparent proxy, where client is unaware of the existence of a proxy.
Couple of tweaks need to be done, especially for HTTPS since the assumption is client would send CONNECT request.

Well actually the client would be making HTTP request to public.example.com which would, in turn, repost the HTTP requests to private.example.com. The originating client could be sitting anywhere on the internet in this scenario. Does it make sense?

Yes. You can make this proxy listen to port 80 on private.example.com. However only HTTP requests would work.
If you don't want to use port 80 you can use listen on some other port, and then let public.example.com forward it to that port.

Transparent EndPoints are now Supported with version 2.1. However Server Name Indication is not supported yet. Closing this.


Lucid link url not working

we use downloadURL=$(curl -s https://www.lucidlink.com/download | awk -F "href="" '{print $2}' | awk -F """ '{print $1}' | grep pkg) for now

@peterlbk What happens when you try the existing link https://www.lucidlink.com/download/latest/osx/stable/? Do you get an error?
The _blank portion of your second command may also not be getting captured correctly due to your use of double quotes but I'm not certain.

sorry @liquidz00 , nothing gets downloaded

Neither of the two corrections worked for me. However curl -s https://www.lucidlink.com/download | grep -o 'href="[^"]*pkg[^"]*"' | sed 's/href="//; s/"//'  does.

As far as I can tell, downloadURL="https://www.lucidlink.com/download/latest/osx/stable/" is still working on the lucidlink label.
I am seeing an issue with appNewVersion. I found the issue and can fix it with a PR soon. It should be using curl -fsIL "${downloadURL}"  | grep -o 'location: .*\.pkg' | sed -E 's|.*-([0-9]+\.[0-9]+\.[0-9]+)\.pkg|\1|' otherwise it gets both location: fields and prints both lines.

Hi,
So sorry for my late response here, but we wrote an official recipe label, years ago and it's working for us. Let me know if you need any further details.
Cheers
lucidlink)
name="Lucid"
# https://www.lucidlink.com/download
type="pkg"
downloadURL="https://www.lucidlink.com/download/latest/osx/stable/"
appNewVersion=$( curl -fsIL "${downloadURL}" | grep -i "^location" | awk '{print $2}' | sed -E 's/./[a-zA-Z]-([0-9.])../\1/g' )
expectedTeamID="Y4KMJPU2B4"
;;


Tutorial

Hi Mr. Rene Delgado,
can you give me a tutorial how to work.
Regards

Hi,
I wrote a tutorial this morning.
This doesn't explain how it works but you can use it to run the code at least.
In the next days I will write something better.
Regards.

Many thanks Mr. Rene Delgado, waiting for your tutorial. Basically, now I am working on periodic/dynamic per-host bandwidth allocation based on some network parameters in RYU. I hope that your code can help me.
Regards,

Hi,
I wrote a little more. Tell me if you have any question.
https://github.com/RDelg/OF-BW-Control/wiki/Tutorial

Ok many thanks


Extract origin/direction from VectorCamera

@mattngc
The VectorCamera class does not return the input pixel origin/direction which could be a useful output when using the data from VectorCamera at a different stage in the code. Could these two variables be added to the class such that:
camera=VectorCamera(pixel_origin,pixel_direction)
print(camera.pixel_origin,camera.pixel_direction)

This sounds like a sensible change. I will make the respective properties readonly.


[SPARK-10136] [SQL] A more robust fix for SPARK-10136

PR #8341 is a valid fix for SPARK-10136, but it didn't catch the real root cause.  The real problem can be rather tricky to explain, and requires audiences to be pretty familiar with parquet-format spec, especially details of LIST backwards-compatibility rules.  Let me have a try to give an explanation here.
The structure of the problematic Parquet schema generated by parquet-avro is something like this:
message m {
  <repetition> group f (LIST) {         // Level 1
    repeated group array (LIST) {       // Level 2
      repeated <primitive-type> array;  // Level 3
    }
  }
}

(The schema generated by parquet-thrift is structurally similar, just replace the array at level 2 with f_tuple, and the other one at level 3 with f_tuple_tuple.)
This structure consists of two nested legacy 2-level LIST-like structures:

The repeated group type at level 2 is the element type of the outer array defined at level 1
This group should map to an CatalystArrayConverter.ElementConverter when building converters.

The repeated primitive type at level 3 is the element type of the inner array defined at level 2
This group should also map to an CatalystArrayConverter.ElementConverter.

The root cause of SPARK-10136 is that, the group at level 2 isn't properly recognized as the element type of level 1.  Thus, according to parquet-format spec, the repeated primitive at level 3 is left as a so called "unannotated repeated primitive type", and is recognized as a required list of required primitive type, thus a RepeatedPrimitiveConverter instead of a CatalystArrayConverter.ElementConverter is created for it.
According to  parquet-format spec, unannotated repeated type shouldn't appear in a LIST- or MAP-annotated group.  PR #8341 fixed this issue by allowing such unannotated repeated type appear in LIST-annotated groups, which is a non-standard, hacky, but valid fix.  (I didn't realize this when authoring #8341 though.)
As for the reason why level 2 isn't recognized as a list element type, it's because of the following LIST backwards-compatibility rule defined in the parquet-format spec:

If the repeated field is a group with one field and is named either array or uses the LIST-annotated group's name with _tuple appended then the repeated type is the element type and elements are required.

(The array part is for parquet-avro compatibility, while the _tuple part is for parquet-thrift.)
This rule is implemented in [CatalystSchemaConverter.isElementType] 1, but neglected in [CatalystRowConverter.isElementType] 2.  This PR delivers a more robust fix by adding this rule in the latter method.
Note that parquet-avro 1.7.0 also suffers from this issue. Details can be found at [PARQUET-364] 3.

Merged build triggered.

Merged build started.

Although #8341 is hacky, it's still a valid fix. I won't list this PR as a blocker for 1.5 at this time since RC1 is already cut. But I'd like to have this merged into branch-1.5 if there's RC2.

Test build #41376 has started for   PR 8361 at commit 15cd105.

(No more test cases added in this PR because those added in #8341 already cover this issue.)

Test build #41376 has finished for   PR 8361 at commit 15cd105.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41376/
Test PASSed.

Merged build triggered.

Merged build started.

Test build #41407 has started for   PR 8361 at commit 74802cd.

Test build #41407 has finished for   PR 8361 at commit 74802cd.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41407/
Test PASSed.

Merged to master and branch-1.5.


DBZ-6960 Include REDO SQL in Oracle source info block

https://issues.redhat.com/browse/DBZ-6960

/packit test --labels oracle

/packit test --labels oracle


Improve legibility of failing tests for IStrategy implementations

Overview
Part of the motivation for #1 and #2 was to make it easier to write tests against IStrategy implementations, and particularly to move test data closer to the tests, rather than being forced to use TheoryData. Previously I had (erroneously) thought I could only pass one array to a test method by using params, not realising an array could be passed to the ctor of an attribute. The plan was to allow strings to be used for the hint and line parameters which could be parsed into Hint and Line types respectively. This worked but led to output on failing tests similar to:
Expected newTrivialStrategy().Execute(hint,line) to be equal to {CellState { Description = Filled, Boolean = True, Character = 1 }, CellState { Description = Filled, Boolean = True, Character = 1 }, CellState { Description = Filled, Boolean = True, Character = 1 }, CellState { Description = Filled, Boolean = True, Character = 1 }, CellState { Description = Filled, Boolean = True, Character = 1 }}, but {CellState { Description = Undetermined, Boolean = , Character = . }, CellState { Description = Undetermined, Boolean = , Character = . }, CellState { Description = Undetermined, Boolean = , Character = . }, CellState { Description = Undetermined, Boolean = , Character = . }, CellState { Description = Undetermined, Boolean = , Character = . }} differs at index 0.

Clearly, this is horrendous to read and to try to work out what the actual issue is 😢
Cause
The problem is caused by Line now implementing IEnumerable<CellState>. This means the Should extension method returns a GenericCollectionAssertions and compares the Line as an enumerable, checking each element in the enumerable. If it finds a CellState that doesn't match it then outputs the enumerable. The default behaviour here is to use the ToString method on each element in the collection. In our case that is a record struct so we get the default implementation of a comma delimited list of the public properties!
Potential Solutions
Override ToString on CellState
This dramatically improves the format of the output, and gives us something similar to:
Expected newTrivialStrategy().Execute(hint,line) to be equal to {1, 1, 1, 1, 1}, but {., ., ., ., .} differs at index 0.

This is much more readable. It has the advantages of being low impact in terms of the number of places we would need to make changes. It also gives us the advantage of seeing the first index where there is a difference. This also keeps the ToString implementation in line with the implicit conversion to string.
On the downside, this changes the ToString implementation from what people might expect for a record, so is arguably a violation of the principle of least surprise. Repeated strings of ., might also be a little tricky to read.
Convert Line to string and compare that
This dramatically improves the format of the output, and gives us something similar to:
* Expected ((string)actual) to be "11111", but "....." differs near "..." (index 0).

This also has the advantage of being able to see the index for where the first differences appear, and having much shorter output. Assuming we supply the input data as a string we see comparison against similar values. This makes sense from an implementation point of view. Finally, we also keep the expected implementation of ToString for a record in place.
This has the downside of requiring more changes, but not excessively so.
On the down
Manually enumerate CellStates and compare individually
This requires more work so I haven't got sample output for this option. However, because we could use an AssertionScope we would be able to see the index of all cells that did not match. In addition I would be able to use the because and becauseArgs params of Be to be something along the lines of should have been {0} but was {1} to give a more descriptive explanation.
This would require each test changing, and in a very similar way. I could introduce some form of helper that would be consumed by all test cases, but the MO so far with this repo has been to experiment with having as much code as possible in the test itself, and to try to avoid things such as shared set-up etc
This would also end up comparing CellStates; it is just that we're doing it by hand rather than letting Fluent Assertions do it for us. That means we'll still pick up the default implementation ToString for CellState which could be clumsy in the test output.

Thinking through this a bit more in theory we should be able to extend functionality of Fluent Assertions for a "helper" to compare two instances of Line for value equality, and with a nicely formatted output including all indices. If this were essentially part of the assertion library we're using that would be far more palatable than some random helper class.
It looks like I would need:

[ ] An extension method of Line to return e.g. LineAssertions
[ ] A LineAssertions type that

[ ] Constructs and consumes a validator
[ ] Returns an appropriate AndConstraint

[ ] A LineEqualityValidator with e.g. Validate that performs the item by item comparison

I need to take a closer look at the source for Fluent Validation to figure out exactly how to do this, but seems like the tidiest approach.
We could probably also extend comparisons against string but to treat it as a Line which would simplify calling. However, that might leave the assertion code a bit hidden away.


Tidy SilenceWarnings context manager

Summary
No functional changes, just cleaning some things up as I touch the code. This PR cleans up the SilenceWarnings context manager:

Fix type errors
Enable SilenceWarnings to be used as both a context manager and a decorator
Remove duplicate implementation
Check the initial verbosity on __enter__() rather than __init__()
Save an indentation level in DenoiseLatents

QA Instructions
I generated an image to confirm that warnings are still muted.
Merge Plan

[x] ⚠ Merge https://github.com/invoke-ai/InvokeAI/pull/6492 first, then change the target branch to main.

Checklist

[x] The PR has a short but descriptive title, suitable for a changelog
[x] Tests added / updated (if applicable)
[x] Documentation added / updated (if applicable)

Rebased on main and re-tested. This is ready for a full review.


Keras iterator with augmented images and other features

Say you have a dataset that has images and some data in a .csv for each image.
Your goal is to create a NN that has a convolution branch and an other one (in my case an MLP).
Now, there are plenty of guides (one here, another one) on how to create the network, that's not the problem.
The issue here is how do I create an iterator in the form of [[convolution_input, other_features], target] when the convolution_input is from a Keras ImageDataGenerator flow that adds augmented images.
More specifically, when the nth image (that may be an augmented one or not) is fed to the NN, I want it's original features inside other_features.
I found few attempts (here and here, the second one looked promising but I wasn't able to figure out how to handle augmented images) in doing exactly that but they do not seems to take into account the possible dataset manipulation that the Keras generator does.

Answered here:
https://stackoverflow.com/questions/60513146/keras-iterator-with-augmented-images-and-other-features


Crop selection not showing on image altough  crop object looks fine

It worked before and appeared suddenly. Although my crop object looks fine
{
  aspect: 1.3333333333333333
  height: 100
  width: 88.88888888888887
  x: 0
  y: 0
}

the selection is not shown on the image. I'm clueless. Is it possible that it's a CSS issue or something?

What was your eventual solution for this?

Forgot to import the css file :laughing:

Haha, yup, that fixed it for me. Thanks!


Ionic2 beta10 How to call the Cordova plugin not in the typings list？

I use the Ionic2  beta10 version development app, i can use the FileTransfer plugin to download the PDF file, but how to call the local application to open the PDF file?
To search for "# cordova-plugin-file-opener2" this plugin can call the local application to open the file, in beta6 JS version can directly use this plugin to open the file, but the default the latest beta10 is ts template, the TS to develop, need plugin will turn into TS version can be used. "Typings search file" no TS version of "cordova-plugin-file-opener2" this plugin. So how to call it in the TS?
Or how to turn "cordova-plugin-file-opener2" into a TS version of the plugin to typings?
Ionic2 Beta10 Version！
@alakra

Hi @iraychen
install cordova typings
typings install cordova --global --save
then edit code
from
interface CordovaPlugins {}
to
    fileOpener2?:any;
}```

Hello! Thanks for opening an issue with us! As this seems like more of a support question i will urge that you ask this question on our forum (forum.ionicframework.com). Thanks for using Ionic!

@jtushar53 thank you! Using your method, I solved the problem.

@jgw96 Sorry!

Can all of cordova plugin use this way?

hi @liangzhanyong
it depends
there are some other ways too. check out this http://stackoverflow.com/questions/12709074/how-do-you-explicitly-set-a-new-property-on-window-in-typescript


Add a global config key

Using the new :global entry in config_defaults.yml and .sync.yml,
data can be shared across files in a module.

I think using the :global key in @configs is fine. Did you have any further thoughts on this?

Hi, if you're OK with:global, I'd ask you to merge it as is. I've rebased to current master to resolve the conflict.


Wrong profile url in .all-contributorsrc file and readme file

Describe the bug
A clear and concise description of what the bug is.
Hey, I think you accidently added a wrong url to my profile in .all-contributorsrc and readme file.
The correct url to my profile will be - https://github.com/Kushagra-ag
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

Seems all-contributors did wrong ;) Would you mind open a PR to fix this ? README and contributorsrc have to be updated

Sure. PR #129


Name of release-jar-file does not start with p3-

Having a look at the releases, I noticed that the name of the jar-file including all the dependencies does not start with p3-*... Simply close this issue if that's not important...

I think most projects don't. The "p3-" prefix convention affects only the git repo names.

Ok, fine, thanks for clarification


Newsletters: add 147 (2021-05-05)

[ ] Update topics @harding
[ ] BTCPay 1.1.0 @bitschmidty
[ ] Bitcoin Core #19160 multiprocess: Add basic spawn and IPC support @jnewbery
[x] Bitcoin Core #21009 Remove RewindBlockIndex logic @Xekyo
[ ] LND #5159 AMP support for SendPaymentV2 @dongcarl

Ooops. Didn't mean to click on 'approve'. Not sure how I can remove that.

Added Bitcoin Core 19160

Pushed (hopefully) final edits, including updated topics.  Reviewed the excellent contributions by @bitschmidty, @jnewbery, @Xekyo, @dongcarl, and @jonatack.  Thanks everyone!

Made a couple updates per @jonatack feedback. Squashed and merged.
Pleasure working with this team week in and week out. Thanks to all contributors this week: @jonatack @harding @jnewbery @adamjonas @Xekyo @dongcarl


Did not see observability data for local environment until plugin reset

I have just exected an API call.
I can see the information in the Docker extension, but the environment and data does not appear int he observability anel in the plugin:

Please note that in the Docker extension, I see two environments, this may the issue?

After restarting the plugin, the data suddenly appeared:

I can't reproduce it
@doppleware lets' have a session

Probably related to the recent activity refresh issue, closing


Feature/data validation continued

Resolves #59. Interdependent property checks for the IdentityObject class as a task function. New capability to add plain tasks from ClassValidators

Gotta merge this to keep going. Comments or additional PRs welcome after the fact.


iOS - missing "example" + glitch

@antongotech fixed by #123 - but let's:

Verify that the technique used in the fix is acceptable
Run QA on Safari - mobile + desktop sizes because the bug only appeared there


Add bevy_image, bevy_post_processing and bevy_anti_aliasing

Not sure if we'll need all of them but it seems safer to reserve them now.

Closing as this has to be done manually. Just reserved them!


Improve readme

Hi! Just noticed some minor errors (like spelling and grammar) in your readme, so I thought I could help you clean up. If you would like, I can improve the readme a bit more.

Thanks, I am dyslexic so I gladly accept any spelling help I can get :-)


remove "Check out some demos!" in readme

there is no demo... it's a circular reference

We'll get on this soon. This was a miscommunication as we wanted to take
the old demos down (they used an old version of the polyfill).
On Tue, 21 Apr 2020 at 22:26, Jimmy Wärting<EMAIL_ADDRESS>wrote:

there is no demo... it's a circular reference
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/GoogleChrome/dialog-polyfill/issues/196, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAA5DEBCOSVHWEHAGDKABBLRNWGHJANCNFSM4MNIM6IA
.

I've added some demos again. Please check out the link again!


NFR-MCT-013 - Concurrent users

The MCT should allow multiple users to access the service simultaneously without incurring delays.

how will scheduling work? race conditions?


Date-based histograms seem broken on the feature site

Subsetting: bin slider has "BIN WIDTH (UNDEFINED)" (should be 'MONTH' or other time unit)
Viz: "BIN WIDTH (MONTH)" but default width is a non integer and seems generally messed up.
On first glance - the back end responses seem fine, but Danielle asked me to check things are working after she pushed some fixes, so I will look at front and back end for an explanation.

Well it turns out everything's fine on the main branch using dfalke-b services
Don't know what's up with the feature site, but it's all working fine and I've fed back to Danielle that those issues are fixed.


added in rle decoder for boolean

Closed since it was a duplicate of https://github.com/facebookincubator/velox/pull/11282


Performance capture for sw_engine

This just notes the current status of the performance profiling result in order that later we can compare the difference.

replaced with this : https://github.com/Samsung/thorvg/wiki/Performance-History


Hamiltonian from density matrix

Hello,
Im doing a project of mine and have stumpled on your code.
Is there any way I can take pyscf and define a molecule, let pyscf determine the orbitals to use, and then in the end allow me to write a arbitrary density matrix and make pyscf give me the system Hamiltonian from DFT?  In short can i make pyscf evaluate H(density) for any density i might like once the structure is defined?
Best regards,
Aleksander

If it is just the Fock  matrix, then you can try the following
mol = gto.Mole(...) #define the structure
mf = scf.RKS(mol)
mf.xc = 'pbe'
vxc = mf.get_veff(dm=your_density_matrix)
H = mf.get_hcore() + vxc

Hi,
Thanks for the answer.


Add Hobo Latest Cask

Created a new Cask for ClickOnTyler's Vagrant management tool, Hobo.

Thank you for the contribution. It needed some fixes, so they were made in the below referenced pull request. Your contribution is still included (and still credited to you), with the appropriate modifications. Please feel free to ask about any of the changes.

Thank you. I've only recently discovered Cask but am already falling in love. I appreciate the opportunity to help make it better.
Regarding the changes you made, I had used the Cask for another ClickOnTyler application, Virtual Host X, as a template.
I was already planning to submit a pull request correcting the license. Should it also have its version hard coded as well?

I appreciate the opportunity to help make it better.

We appreciate your help as well.

Should it also have its version hard coded?

Yes, please, since there’s a url available (https://downloads-clickonideas.netdna-ssl.com/virtualhostx/virtualhostx60_6.0.4.zip) that allows for it.


switch to 1.13RC of reporting

integrate latest reporting and perform base sanity check.

done: https://github.com/zebrunner/zebrunner/commit/0f8c20f459be43d4f14904e4905fad773ad891a5

clone recursively zebrunner/zebrunner using develop branch.
verify that reporting submodule is

git submodule status
e2cbd1f754a38dce0043b9460ed187a29cf01262 reporting (1.12.1-13-ge2cbd1f75)

do sanity check using testlaunchers and registerrepository under custom organization
run api and web tests by launcher and custom org repo

Created a separate bug for reporting https://solvd.atlassian.net/browse/ZEB-1918

Tested on dev. Done.


Add a status for each rule

We now have many rules offered by Codelyzer. However, some are experimental, others deprecated and many are stable.
it would be nice to give clarity on this to our users.
Maybe we can add a property in IRuleMetadata.

@wKoza good idea!

Agree.
Could not find implementations for the following rules specified in the configuration:
    template-to-ng-template
    templates-use-public
    no-access-missing-member
    invoke-injectable

... nor could I :-)

We have this in the readme.


how to turn off a feature from node.js redis?

I'd like to turn off a feature (by unsetting a constance value in redis)
I'm doing it from node.js.
It seems constance uses python pickle's dump to store truth value.
Isn't the dumped value supposed to change as pickle changes with python version?
How should I toggle truth values from outside of python world?
I'm setting I00\n. for False value. Does this look ok?

This isn't supported, sorry.

This is still a problem for django-constance. Trying to resolve it in linked PR


PostgreSQL binding spec doesn't describe expected InvokeBindingAsync input/output types

What content needs to be created or modified?
The PostgreSQL binding spec documentation shows expected inputs and outputs, but doesn't provide any information on invocation via the Dapr Client SDK. That makes calling InvokeBindingAsync<TRequest, TResponse> a bit difficult, as you're forced to guess the return type. (Surprise, it's not BindingResponse but rather appears to be JsonElement.)
Describe the solution you'd like
The Binding support section should probably have a set of tabs--Dapr SDK or HTTP--to differentiate the request/response code blocks and show the aforementioned information.
Where should the new material be placed?
The Binding support section. See above.
The associated pull request from dapr/dapr, dapr/components-contrib, or other Dapr code repos
N/A

@riverar - I would love a suggested PR for the docs, if you could submit one. Could you do that? Thx

@riverar friendly bump

Before

(Proposed) after

Outstanding questions

Which tab do you show first?
Which parameters do you demonstrate? All? Required only?
What parameter data do you use? Placeholders? Dummy data?
Should there be a table of parameters before the tabs, somewhat akin to APIs documented on Microsoft Docs?


Allow Destination without scheme

I am using tower_grpc + tower_hyper to communicate with a grpc service hosted in aws. The routing for our ecs services is a bit unusual. In our other grpc services and test tools like bloomRPC we can connect to services with service-name.aws.companyname.com but http://service-name.aws.companyname.com fails to resolve.  Since Destination validates presence of scheme I cannot connect to any grpc services. Would it be possible to allow a destination to be created without validating the presence of scheme?
For reference sake this is how I am currently calling hyper:
use crate::env::*;
use futures::Future;
use http::Uri;
use hyper::client::connect::{Connected, Destination, HttpConnector};
use tower_grpc::codegen::server::tower::MakeService;
use tower_grpc::Request;
use tower_hyper::{client, util};
use tower_request_modifier::Builder;
use sales_client::UpsertChecksRequest;

pub mod common {
    include!(concat!(env!("OUT_DIR"), "/avero.common.rs"));
}

pub mod sales_client {
    include!(concat!(env!("OUT_DIR"), "/avero.sales.rs"));
}

pub fn call_client(env: &Environment, upsert_request: UpsertChecksRequest) -> () {
    let uri: Uri = env.sales_url.parse().unwrap();
    let dst = Destination::try_from_uri(uri.clone()).unwrap();
    let connector = util::Connector::new(HttpConnector::new(4));
    let settings = client::Builder::new().http2_only(true).clone();
    let mut make_client = client::Connect::with_builder(connector, settings);
    let call_client = make_client
        .make_service(dst)
        .map_err(|e| panic!("cannot connect to sales service: {:?}", e))
        .and_then(move |conn| {
            use sales_client::client::SalesService;
            let conn = Builder::new().set_origin(uri).build(conn).unwrap();

            // Wait until the client is ready...
            SalesService::new(conn).ready()
        }).and_then(|mut client| {
            println!("calling client");
            client.batch_upsert_checks(Request::new(upsert_request))
        })
        .and_then(|response| {
            println!("RESPONSE = {:?}", response);
            Ok(())
        })
        .map_err(|e| {
            println!("ERR = {:?}", e);
        });
        tokio::run(call_client)
}

Hm, HTTP/2 demands we send a :scheme header, so if you didn't pick one, hyper would need to instead. What do you mean you can connect to the domain but not with http://?

In #2035, the Destination type was removed completely.


[cherry-pick][BEAM-10950] Passing project properly in BQSource

Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

r: @robinyqiu

@pabloem Could you take a look at the failing tests? Are they relevant?

Run Python_PVR_Flink PreCommit

I believe failures now are due to the missing Dataflow worker containers


Update yaml to mention point to consul leader

What does this PR do?
Add line to the yaml file to mention this should be the leader the URL points to.
Motivation
The Consul check is designed around pulling metrics from the leader node. If the URL specified in the yaml is not the leader, then most of the metrics/service check functions are skipped and the consul.peers metric is submitted. This makes it clearer that the provided URL should be the URL of the leader.
Review checklist

[ ] PR has a meaningful title or PR has the no-changelog label attached
[ ] Feature or bugfix has tests
[ ] Git history is clean
[ ] If PR impacts documentation, docs team has been notified or an issue has been opened on the documentation repo

Additional Notes
Anything else we should know when reviewing?

Just stumbled upon that and it's confusing. How is that supposed to work? The leader can change, no?

Hey @hamann You're right that the leader can change. The was the check worked at this point meant that it could only pull substantial metrics if it was pointed at the leader. This PR was aimed at just clarifying that instead of refactoring the logic. That being said, there was a newer PR that attempted to work around this - https://github.com/DataDog/integrations-core/pull/2461

@nmuesch Ok, thanks! So mentioning leader in
https://github.com/DataDog/integrations-core/blob/abf2414dc4202a695b8da172f4df09d949257063/consul/datadog_checks/consul/data/conf.yaml.example#L6
is outdated as well?


can't install multiPrime2-GUI

Hi, I download the multiPrime2-GUI，but can't install successful. Failed to execute script 'multiPrime-core_GUI' due to unhandled exception: cannot unpack non-iterable NoneType object.

Installing multiPrime2 is unnecessary; simply unzip the repository and execute the multiPrime2-GUI.

@Eager144000
Thank you for raising this question. Confirming that the path does not include Chinese characters will resolve the issue. I believe that we have successfully addressed this concernand in the meeting. Could you please proceed to close the question?


Docs, offline checking, mod keyword

Could use /// like Rust does and generate markdown.
Docs
When creating a library for a Dyon scripting environment, a .dyon file is kept for declaring external functions, where functions have the body { ... }.
Example:
/// Prints variable to standard output.
fn println(var) { ... }

The docs are generated from this file, but also performs offline lifetime/type checking.
Offline lifetime/type checking
The documentation generator could be more strict than the lifetime checker, because this is meant for sharing code, so there are additional requirements to make the code of higher quality:

Types on all arguments and return values
Document comments on all functions
Declare all external functions with a { ... } body (or use mod keyword)

mod keyword
Declaring all external functions is not practical for every source file. For reusing declarations, a mod keyword can be used to point to a file or url.
Example:
Look for render.dyon in same directory.
If not found, look for render/mod.dyon.
mod render

Look for src/lib.dyon in the "dyon" repository.
mod "https://github.com/PistonDevelopers/dyon/"

Notice! This is not used when running, only used by the offline type checker. The scripts use load_source_imports to avoid overhead by having dependencies loaded in memory and only accessing a single file for reloading a module.
A file is relative to the directory which contains the .dyon file. ../ is allowed to go up one directory. If the file is not found, a folder with the same name and containing a mod.dyon can be used instead. This makes it easier to organize the code similarly to Rust.
If an url points to a Github repository, the root is src/lib.dyon.
When pointing to an url, the file gets downloaded and put in a src/lib/ folder, using a glob id or hash as file name and a JSON document describing the relationships between the downloaded files and the glob id/hash.
The src/lib/ folder is checked before downloading. This folder is relative to project directory, which is searched for by checking parents and then children using the "find_folder" library. If the src/lib/ folder is not found, it looks in a shared folder set by an environment variable.
Namespace and shadowing
All functions belong to the same namespace, but replacing another when shadowing.
The offline checker reports an error when calling a function is shadowed from another module.
If a function name starts with two underscores, e.g. __foo, the offline checker will not complain.
The order which documents are loaded is sequential from top to bottom. When a module depends on other modules, the dependencies are added before the module.
|- mod foo_dependency_1
|- mod foo_dependency_2
mod foo
|- mod bar_dependency
mod bar

Motivation
The implementation of a function can vary greatly from application to application. We need a way to make sure code is reusable without loosing the flexibility of how dynamic modules are loaded.
A matching function signature makes code reusable across projects. If Alice wants to share code with Bob, but they use different engines, they can agree upon a module that defines a common interface. All code using this declaration will then be checked offline such that breaking changes can be detected.

I feel like the ability to download scripts from the internet can be a security risk. It could be used to download malicious code.

This needs some rethinking. Don't want to build a package manager for Dyon, since I think it is better to write Rust code in general when scripting is not needed.
Closing.


Issues to discuss

What is the maximum number of cores and mem we would use in the shared database?
How general or specific should we be for file sizes?
Should the allow pulsar tag be in the central database?
Are the dynamically generated destination name important for the sorting hat?
Automated translation of sorting hat to tpv

Done during GCC2022.


Bug: Videos Not Playing in Videothumbnels on the Videos section

Description:
The video section of the website, specifically the Videothumbnels feature, is not functioning as intended. While the video thumbnails are visible, the videos themselves are not loading or playing. This issue is impacting the user experience and potentially hindering product demonstrations and customer engagement.
Expected Behavior:
When a user clicks on a video thumbnail, the corresponding video should begin playing seamlessly within the video thumbnail.
Potential Causes:
Incorrect video file format or encoding or videos are not there.
Priority: High
@soham0005 Please assign this task to me for GSSOC extn.

@Sumanbhadra do create another branch and work on that branch to maintain consistency.

@Sumanbhadra right now, we do not have enough video links to have rendering, so it's in our todo

For now, I can add some YouTube videos of the products.


[Progress] Progress Indicators missing labels - Accessibility

When running automated jest axe scans for our internal use of the MUI Progress Indicators, we encountered failures for our implementation. I noticed these failures were also happening on the Material UI docs page, as there are no labels associated with these examples. These errors are related to both the CircularProgressIndicator examples and the LinearProgressIndicator examples. Not sure if the best outcome is actually adding labels to these examples, or making a note about this in an accessibility section on the page.  I'd be happy to contribute a PR for whatever fix the team feels would beneficial to the documentation!

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
When running an automated axe scan on the page https://material-ui.com/components/progress/, there are serious failures for  each of the examples on the page regarding the "ARIA progressbar nodes must have an accessible name" rule.
Expected Behavior 🤔
There should be no axe scan issues for the specified rule. Each Progress Indicator should have an associated label. For the Customized Circular Progress example, the grey background circle should have aria-hidden set to true to prevent the second progress indicator from being read by screen readers, as that example is comprised of two CircularProgress components laid on top of each other.
Steps to Reproduce 🕹
Steps:

Navigate to the Progress documentation (or the next release's Progress docs )
Using the axe DevTools plugin, open the tool and run 'Scan All of My Page'.
Note the Serious failures and use the Highlight feature to examine where these issues are occurring on the page.

Context 🔦

My team has internal demo docs for each of the MUI components, and we run automated a11y scans on each of our examples so that's how we encountered this. Our Design System team strives to give the other employees at our company fully accessible implementations that they can reference.
Your Environment 🌎
This is happening on the docs pages at both v4.11.1 and v5.0.0-alpha.37, but I've included my environment information as well.

`npx @material-ui/envinfo`
System:
OS: macOS 11.4
Binaries:
Node: 12.18.4 - ~/.nvm/versions/node/v12.18.4/bin/node
Yarn: 1.22.5 - /usr/local/bin/yarn
npm: 6.14.6 - ~/.nvm/versions/node/v12.18.4/bin/npm
Browsers:
Chrome: 91.0.4472.106
npmPackages:
@emotion/styled:  10.0.27
@material-ui/core: ^4.11.4 => 4.11.4
@material-ui/data-grid: 4.0.0-alpha.21 => 4.0.0-alpha.21
@material-ui/icons: ^4.9.1 => 4.11.2
@material-ui/lab: ^4.0.0-alpha.45 => 4.0.0-alpha.57
@material-ui/pickers: 4.0.0-alpha.9 => 4.0.0-alpha.9
@material-ui/styles:  4.11.4
@material-ui/system:  4.11.3
@material-ui/types:  5.1.0
@material-ui/utils:  4.11.2
@types/react:  17.0.3
react: ^16.11.0 => 16.14.0
react-dom: ^16.11.0 => 16.14.0

please let me know some good first issues that I can work on as I am new to open source

Hello,
Wanted to reach out and see if anyone is working on this one? I know this issue hasn't been updated since 2021 but the issues laid out above are still present on the current page with the progressbars not having an accessible name.
If no one is, I'd be happy to try and take a stab at it.


Added l4vr0v’s stuff to the list of folders

Hey could I get an invite to your guy’s discord? @EFHIII


[In-Person Event] seL4 Summit 2023

In-Person Event Submission
Requirements

Event Name: seL4 Summit 2023
Link to the Event Website: https://events.linuxfoundation.org/sel4-summit/
Are you an organizer of this event? Yes

Event Demographics

[x] This event commits to Event Diversity and Inclusion.

Q Detail the process for measuring Event Demographics.
A We ask several questions in the registration process in order to compile attendee demographics, and to better cater to our attendees onsite to ensure they can enjoy the event to the fullest: Do you have a disability that we should be mindful of as we try to accommodate everyone for this event? Please specify dietary needs (if any). If you have a dietary need that isn’t listed, email us at<EMAIL_ADDRESS>and we will make every reasonable effort to accommodate your need(s). Do you identify as a person of color? What gender do you identify with? How old are you? (Please note, none of these questions are required, they are optional for attendees to fill out)
Q Provide an example of an opt-out option on the Event registration page if available.
A All demographic questions on our registration are optional.
Q Provide an example of a demographics text input box on the Event registration page if available.
A On the attendee information page we provide a list of pronouns to chose from but also provide a space for text input if none of the options provided apply.

Inclusive Experience at Event

[x] This event commits to the Code of Conduct at Event.

Q Provide an example of the Event Feedback page if available.
A We send out a post-event survey to all speakers and attendees where we ask the following question: “Diversity and Inclusion are vital to the future of the linux ecosystem and it is imperative to us that everyone in the community that wants to participate feels welcome to do so. Please share any feedback or ideas regarding Diversity and Inclusion initiatives to help us improve future events.” We also encourage all attendees to share any ideas with us during the event, and have the contact information for the SVP & GM of Events as well as the specific Event Manager made easily accessible should anyone want to share their feedback prior, during, or after the event.
Q Is the event team using feedback from previous event's attendees, speakers, and volunteers to improve DEI at this event?
A Yes, the information gathered from the previous year's post-event survey was considered when planning 2023.
Q Does the event team plan to use feedback from this event's attendees, speakers, and volunteers to improve DEI at future events?
A Yes, we continue to use our post-event survey to collect feedback to be considered for future events
Q How can attendees learn more about accessibility at the event?
A Under the Diversity and Inclusion page on the event website there is a section that speaks to venue accessibility.
Q Does the event platform allow attendees to suggest future accomodations for the event?
A We send out a post-event survey to all speakers where we ask the following question: “Diversity and Inclusion are vital to the future of the linux ecosystem and it is imperative to us that everyone in the community that wants to participate feels welcome to do so. Please share any feedback or ideas regarding Diversity and Inclusion initiatives to help us improve future events.” We also encourage all attendees to share any ideas with us during the event, and have the contact information for the SVP & GM of Events as well as the specific Event Manager made easily accessible should anyone want to share their feedback prior, during, or after the event.
Q Will the event platform be accessible to attendees and speakers after the event?
A Yes, it will be made available at the conclusion of the event via YouTube to all at no charge.

Code of Conduct at Event

[x] This event commits to the Code of Conduct at Event.

Q Is the code of conduct posted at Event venue?
A Yes, we have the code of conduct printed onsite and at all off-site venues. We have the code of conduct linked in all event emails, as well as on the onsite Diversity & Inclusion resources flyer. This flyer has all DEI-related resources, as well as event team members they can contact should they need anything onsite.
Q Provide a link for the Event Code of Conduct.
A https://events.linuxfoundation.org/sel4-summit/attend/code-of-conduct/

Diversity Access Tickets

[ ] This event commits to the Diversity Access Tickets.

Q How many different types of diversity access tickets are available for the event?
A At this time we are not providing diversity access tickets.
Q What are the criteria for qualifying for a diversity access ticket?
A N/A
Q Provide a link to the page containing information about Diversity Access Tickets.
A N/A

Family Friendliness

[x] This event commits to Family Friendliness.

Q Does the Event provide childcare facilities for its attendees and speakers?
A We are unable to offer childcare for this event.
Q What are the other ways that a family-friendly environment is being created in the Event?
A We offer our attendees a private nursing room that they can access throughout the event, gender-neutral restrooms, pronoun stickers, and have ADA-accessible transportation provided to any offsite venues.
Q Provide relevant links related to family friendliness at the Event.
A https://events.linuxfoundation.org/sel4-summit/attend/diversity-inclusion/

@germonprez Ignore this issue. I am testing out something

/result

/end


Accessibility: Related links that are not grouped in a list (Failure WCAG 1.3.1)

Institutional landing page - currently in beta
Mandate , Organizational structure, Transparency, .. : Example of related links that are not grouped in a list
Suggested solution:
Use <ul> to group the links
Related WCAG technique:
H48: Using ol, ul and dl for lists or groups of links

These links have now been converted to a list and the changes are live - thank you @RubyDo


test(dm): fix unstable test due to rely on sleep X seconds

Signed-off-by: lance6716<EMAIL_ADDRESS>
What problem does this PR solve?

Issue Number: close #6528
What is changed and how it works?
syncer will sleep 0.5 seconds for each DML job, and there'are 30 DML jobs. So we have confident to check the log every seconds to know syncer is processing inside the transaction.
Check List
Tests

No code

Questions
Will it cause performance regression or break compatibility?
Do you need to update user documentation, design documentation or monitoring documentation?
Release note
`None`.

/cc @buchuitoudegou @GMHDBJD

/merge

/run-dm-integration-test

/merge

/run-dm-integration-test


Fix tuple error, mentioned in some of the issues

Issues
https://github.com/advimman/lama/issues/274
https://github.com/advimman/lama/issues/167
Problem
In the lama-regular model, the latent feature is a single Tensor, while in lama-fourier and big-lama, the latent feature is a tuple of two tensors. In our refinement code, we assumed the feature to be a tuple.
Solution
This PR adds a function that adapts the feature appropriately, and  enables adding future types (if discovered any, although, unlikely).
Also, we update a broken Geomagical website link in this PR itself.
Visual Results

Input Images

Big LaMa (before and after refinement)

LaMa-Fourier (before and after refinement, of course, parameters tuned to this model could make results even better)

LaMa-Regular (the one on which refinement was failing)

Thanks for review! I'll close this PR now, and follow the conventional practice of raising the PR to the upstream main branch


Translated CodeEditor.

As part of #3 I translated the words in the CodeEditor component. Sending it here as a separate PR.

This is great!


Track link clicks in landing page

We are moving away from UTM tags for internal links to avoid creating multiple sessions (and other data polluting side effects). The alternative for the landing page is to track link clicks to the various calls to action, and other buttons.

[ ] In GA conversions, Fathom Goals, or both?
[ ] Which links?

[ ] Header login button
[ ] Search form
[ ] Recently evaluated articles

[ ] Article titles
[ ] Groups
[ ] Discover more groups

[ ] Calls to action

[ ] Log in
[ ] Subscribe for updates (is an external link)
[ ] our blog (is a redirect)

~Footer~

[ ] Do we need standard data attributes to indicate the links?

Not ready, pending feedback from Fountain on the approach for Google Analytics.

Click data

We propose to add a data attribute such as:
Text of the link
where my-value can be extracted for the value or label of the Google Tag Manager event (or any other attribute of that event that makes sense).

This sounds very sensible and is totally achievable. Any value on an element attribute can be tracked - Giorgio can find evidence of this in your current GTM container by looking at the ‘Aria-label …’ variables. For example:
'Aria-label of Social Share click’ variable with a variable instruction of 'gtm.element.attributes.aria-label.value’, firing on link click. Screenshots attached: data model from link click event (Social share on blog); value of variable on event. Both demonstrated in GTM debug/preview window on blog.sciety.org.

Site search

There is also a search GET form on the landing page. It would be useful to track usage of this form as well, but not sure what is best to instrument with such an attribute. The form can be triggered by either the submit button or pressing the Enter key.

Depending on what you want from this, the search should already be tracked. UA (Universal Analytics) has a ’site search’ feature where you can enter the query string capturing the search value. UA report ink below:
https://analytics.google.com/analytics/web/#/report/content-site-search-overview/a167311475w233457116p219087825/_u.date00=20210501&_u.date01=20210527&_.goalOption=4/
This is already recording terms (though there isn’t huge volume yet). Screenshots attached: May search usage overview; May search terms.

If you’re looking for something a little more bespoke, you could use a dataLayer.push({…}) to GTM and set your own custom event, much like the Twitter logged-in event example from the Audit. You could fire this when the search is submitted or when the results are rendered. UA will be quite limited as a reporting framework for this (you’d likely have to rely on the event hit structure: category, action, label); GA4 might be a better home for this as the event model is a lot more flexible.
https://www.analyticsmania.com/post/how-to-track-events-with-google-analytics-4-and-google-tag-manager/
Internal UTM links

We have become aware of session tracking and bounce rate issues that can happen with the use of UTM tags for internal links within Sciety.

If you are tagging internal links with UTMs in a non dynamic way (i.e. the UTMs are hardcoded or added through a CMS) then yes, this would likely confuse attribution. I wouldn’t expect this to affect bounce rate, more that the last UTM visited will override the source UTM for the session.
I couldn’t see any examples of this during my testing - do you have a date range or any in-page examples which demonstrate this?


update chart to be GitOps ready

Summary

give the option to overwrite random string from configmap else applications like argocd will infinity sync because there always a diff

give the option to provide secrets from external because storing secret data like passwords in git is an anti pattern.

remove replicas if ha is enabled. The number of replicas is calculate by hpa else there is a diff between git and the cluster state.

Ticket Link
Fixes https://github.com/mattermost/mattermost-helm/issues/261

@cpanato Conflicts are solved.

Thanks for participating in Hacktoberfest! You can claim your sticker set here: https://get.printfection.com/hacktober21/4144583267 @RenePinnow

This PR has been automatically labelled "stale" because it hasn't had recent activity.
A core team member will check in on the status of the PR to help with questions.
Thank you for your contribution!
/cc @jasonblais @jfrerich @emilyacook

@cpanato
Why was this never merged?

@cpanato Why was this never merged?

there is a conflict that needs to be addressed

@cpanato
I updated my fork again on the newest version. Can you please check and merge. I would like to update mattermost chart and would be nice if it is gitops ready.

there is a lint issue
charts/mattermost-enterprise-edition/Chart.yaml
  40:47     error    no new line character at the end of file  (new-line-at-end-of-file)

also can you squash the commits?

@cpanato
Squashed my commits and fixed the issue.

thanks @RenePinnow for the PR
I will redirect to @spirosoik and @stylianosrigas for review and to sync the merges

@spirosoik can you please merge it?


[firestore-send-email] Support OAUTH2 SMTP connection

[READ] Step 1: Are you in the right place?
Issues filed here should be about a feature request for a specific extension in this repository. To file a feature request that affects multiple extensions or the Firebase Extensions platform, please reach out to
Firebase support directly.
[REQUIRED] Step 2: Extension name
This feature request is for extension: firestore-send-email
What feature would you like to see?
OAuth2 allows your application to store and use authentication tokens instead of actual login credentials. This is great for security as tokens or valid only for specific actions and can be easily revoked thus, once stolen, can’t do as much harm as actual account credentials.
see more...
How would you use it?
While setting the extension instead of the SMTP connection URL

+1


Add support for detecting ` and ~

key-caret can be added to the input but it doesn't actually work (on Windows)

Closing because these can be done in vanilla Defold with detecting text input and ` can be detected as a normal key with key-backquote.


time: incorrect timezone for dates after 2038

What version of Go are you using (go version)?

$ go version
go version go1.13.4 darwin/amd64

Does this issue reproduce with the latest release?
Yes. See: https://play.golang.org/p/zhDzRup9BRP
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/artem/Library/Caches/go-build"
GOENV="/Users/artem/Library/Application Support/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Users/artem/parsec/fed:/Users/artem/parsec/fed/_vendor"
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/Cellar/go/1.13.4/libexec"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/Cellar/go/1.13.4/libexec/pkg/tool/darwin_amd64"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/n0/2pcvtf912dz4qq61kl72vsg00000gn/T/go-build253354351=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?
https://play.golang.org/p/zhDzRup9BRP
package main

import (
	"fmt"
	"time"
)

func main() {
	loc, _ := time.LoadLocation("America/Los_Angeles")
	d1 := time.Date(2037, 6, 3, 11, 0, 0, 0, loc)
	d2 := time.Date(2038, 6, 3, 11, 0, 0, 0, loc)
	fmt.Println(d1)
	fmt.Println(d2)
}

What did you expect to see?
2037-06-03 11:00:00 -0700 PDT
2038-06-03 11:00:00 -0700 PDT

This is behavior that has been produced by other time processing tools and libraries. For example:
$ TZ='America/Los_Angeles' date --date="@2159200800"
Thu Jun  3 11:00:00 PDT 2038

What did you see instead?
2037-06-03 11:00:00 -0700 PDT
2038-06-03 11:00:00 -0800 PST

The CL does not seem restricted to US time zones. Regarding European time (EU), the trend is to discontinue Daylight Saving Time in the coming years (cf. https://ec.europa.eu/transport/themes/summertime_en) although final decision does not seem available.

But note that this particular fix, while worth doing, is somewhat speculative. We don't actually know what the daylight savings time transitions will be in 2038, and so reporting future times as PDT or PST is a guess.

As @ianlancetaylor points out, this is an inherent problem with trying to report future civil times.  There is nothing to prevent the relevant authorities from changing the laws back and forth, potentially on multiple occasions.  Technically some jurisdictions could even enact law that retroactively changes the interpretation of past times....  (Weirder things have happened.  The tzdata files make fascinating reading.)  More prosaically, the tzdata files can be updated or corrected post-facto.
In general, any attempt to make non-trivial use of a future civil time is fraught with difficulty.  Making a best guess in displaying it is about as far as one should probably go.

Australia/Sydney is returning non-DST currently (while we are in DST), at least under Alpine with the tzdata package in version 2020c-r0. The 2020a-r0 version was fine.
Looking at the internals of the TZ data being parsed, DST transition data being parsed by Go for this timezone appears to end ~2008 in the 1.14.2 release of Go

This issues with 2020b and beyond appear to have been captured by https://github.com/golang/go/issues/42138


[dif/lc_ctrl] Add header + impl for LC DIFs

Garret and I have scheduled a Design Review of this for 23rd November 2020.


Request: button loading state

Hi there, can we create a loading state for buttons?

Hey, are you talking about a JS implementation? Or just a spinner inside buttons?

@halfmoonui  Like this: https://u.nu/ug4kl , just CSS implmentation.

Yes. I am planning to add spinner components soon, so loading buttons should be part of that update.

@halfmoonui is this no longer a feature? I also would love loading button states, as well as icon buttons.


[DRAFT] Testing two dependent vsix: ONE-vscode

This is a part of draft to test two depent vsix files:

ONE-vscode (This PR)
FooBackend (#445)

For #442
ONE-vscode-DCO-1.0-Signed-off-by: Hyun Sik Yoon<EMAIL_ADDRESS>

done.


Revert "Atomic bigquery uploads"

Reverts spotify/luigi#1127
Investigating broken master build.

There's usually no extreme hurry to fix build errors if they only affect a small part of luigi like gcloud.
Was it just an intermittent failure? Unfortunately there sometimes are intermittent failures in the luigi build causing extreme confusion. :-/

@Tarrasch Wasn't sure and sort of panicked, but it looks like everything is ok now! :smile:

Great, keep on contributing awesome patches @DeaconDesperado  :)


[4.0][Feature Request] change pagination prev/next button and disable tfooter of datatable

Hi ,
I use https://backpackforlaravel.com/
by default, it shows :

but i want applying it : Previous 1 2 3 4 5 ... 10 Next on all pages .
i don't see < or >. And next allow us to disable tfooter or footer of datatable.
It will be very nice to find this in Backpack  ,Thank you in advance

@tabacitu i give this a look, datatables indeed have the some functionality related to this. Change pagination style, or hide it etc. But i don't think it is worth going much further on this.
If this is something we can provide, i say we should go with simple options like:
tFoot could have a switch functionality like: show_footer => false by default is true.
About the pagination also a switch full_text_pagination => true by default false.
If true we get next and previous lang strings.
Both settingAPI for listOperation.
It's something we should add ?
Best,
Pedro

@paranoid73 in order to have "Previous" and "Next" instead of "<" and ">" you can create a resources/views/vendor/backpack/crud/inc/datatables_logic.blade.php file with the contents of the file in the package, but change these two lines.
@pxpm I don't think this is a customisation we should make easier. Most people must be happy with "<" and ">", since it's the first I hear about it. Personally I think that's better, since it's more general, and it doesn't even need translation. Plus it takes up less space on the screen. Let's close the issue for now. If more people ask for it, we might reconsider.
Cheers!


For #631 Black, pylint and mypy have errors locally, but pass in CI

This is a PR for #631.
So far, this PR has just 1 commit: the changes that were auto-performed by Trent's local black. However, that makes remote CI complain. Something's up...

@trentmc I talked about this. You need to do an upgrade of black locally, since yours is probably outdated now. Probably a pip upgrade too, if black upgrade doesn't fix it.

@trentmc I also have those in pylint, not sure what the difference is, I was used to just ignoring the ones that only show up locally as a config thing. Let's update the issue to reflect just the pylint misalignment, drop this PR and please assign me to the issue. I'll take a look when I finish needling in the time types.

Thanks @calina-c. I just created a new github issue for the specific pylint failures: #644. Therefore I can close this issue and PR.

[@calina-c wrote] drop this PR and please assign me to the issue

Done - in the new issue #644


Base64 decode improvements

Allow ablity to specify the length for decoding.
Allow for non-padded encodings to be decoded properly.

Ah, didn't spot I got re-assigned to this one. Having a look now.

Save it for a minor indentation nit, looks fine.

Fixed. Thanks for spotting that.


Correct? - You have an unlabeled element or control...

Hi,
I'm getting a message about failing validation but I think I'm following the proper convention:
Basically, I have a label and a textarea and have a for in the label and an id in the textarea, but I'm getting this message:
"You have an unlabeled element or control. Add aria-label or aria-labelledby attribute, or put some text in the element."
I think my HTML markup is correct, but maybe not?  Does anyone have any advice on this?
I'm also attaching a screenshot:

Just ran react-a11y for the first time, and got this same message.
I'm also confident that my markup is correct, semantic, and accessible.
If you look closely, you'll notice that react-a11y appears to be rewriting the IDs of your inputs and textareas, breaking the association with their labels. This seems like a serious bug to me.

+1, a11y changes id so it becomes invalid

Hey all, I have a fix for this on my fork: https://github.com/jdan/react-a11y/commit/ee970693b3cbfbf8d55a9c3a7589ccd3cb9c2633
I'm having a remarkably difficult time writing tests for it, though, since the audit needs to run after the component mounts (you'll see in the commit that I hack some login onto the ref attribute), and the testing infrastructure is meant to run after createElement (synchronously)
https://github.com/jdan/react-a11y/commit/973aa43a02711e041ebed03cdf9327be45f6cda8 shows my attempts to test my code - lots of good progress! But I'm getting stumped at this test (https://github.com/jdan/react-a11y/commit/973aa43a02711e041ebed03cdf9327be45f6cda8#diff-c3c2e5784ba4c10e75ef234a6ab0255cR510) because it seems the ref callback sometimes fires after componentDidMount.

I'm having the same issue with input elements

input#first-name You have an unlabeled element or control. Add aria-label or aria-labelledby attribute, or put some text in the element.

<div class="field" id="a11y-8931">
    <label for="first-name" id="a11y-8930">
        First Name
        <input id="first-name" name="first-name"/>
    </label>
</div>

Well, it's been several months and there hasn't been much change on this.
We decided to go with http://www.deque.com/products/axe/ and have been really happy with that.
https://github.com/dequelabs/axe-core
I'm going to close this out.

@crwang Be sure to check out their react offering as well - https://github.com/dylanb/react-axe


[PE-D][Tester D] Prerequisites are not reflective of the information in view modules

Prerequisites are not reflective of the information in view modules
Prerequisites of a certain module code is not shown when running the preq command but it is mentioned that there is that prerequisite in the view function.
To reproduce
Steps to reproduce:

View a mod view Cs1231
Scroll to prerequisites
Find prerequisites of the module preq CS1231

Expected
Module prerequisite should be shown if possible
Screenshots

OS
Windows 10

Labels: type.FeatureFlaw severity.Medium
original: eugenetayyj/ped#6

Update UG:

dont show preclusion
show only modules that are offered by NUS
cannot show all of/ one of relationship

Addressed in #166